-- Logs begin at Mon 2022-08-22 19:27:04 UTC, end at Mon 2022-08-22 21:03:02 UTC. -- Aug 22 20:27:16.119022 dv-osbrick-786733-8-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 22 20:27:16.127283 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 22 20:27:16.131620 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 20:27:16 2022] *** Aug 22 20:27:16.131620 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 20:27:16.131620 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 20:27:16.131620 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: nodename: dv-osbrick-786733-8-ceph Aug 22 20:27:16.131620 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: machine: x86_64 Aug 22 20:27:16.131620 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: clock source: unix Aug 22 20:27:16.131620 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: pcre jit disabled Aug 22 20:27:16.131620 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: detected number of CPU cores: 4 Aug 22 20:27:16.131620 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: current working directory: / Aug 22 20:27:16.131620 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: detected binary path: /usr/bin/uwsgi-core Aug 22 20:27:16.131620 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: your processes number limit is 47680 Aug 22 20:27:16.132868 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: your memory page size is 4096 bytes Aug 22 20:27:16.132868 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: detected max file descriptor number: 2048 Aug 22 20:27:16.132868 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: lock engine: pthread robust mutexes Aug 22 20:27:16.132868 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: thunder lock: enabled Aug 22 20:27:16.132868 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 22 20:27:16.132868 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 20:27:16.184708 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: Python main interpreter initialized at 0x55f84a87e9c0 Aug 22 20:27:16.184708 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: python threads support enabled Aug 22 20:27:16.184708 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: your server socket listen backlog is limited to 100 connections Aug 22 20:27:16.184708 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: your mercy for graceful operations on workers is 90 seconds Aug 22 20:27:16.185269 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 20:27:16.185269 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: *** Operational MODE: preforking *** Aug 22 20:27:16.185476 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: *** uWSGI is running in multiple interpreter mode *** Aug 22 20:27:16.185476 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: spawned uWSGI master process (pid: 88627) Aug 22 20:27:16.185719 dv-osbrick-786733-8-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 22 20:27:16.186314 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: spawned uWSGI worker 1 (pid: 88640, cores: 1) Aug 22 20:27:16.186666 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: spawned uWSGI worker 2 (pid: 88641, cores: 1) Aug 22 20:27:16.188776 dv-osbrick-786733-8-ceph devstack@keystone.service[88627]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 20:27:21.360350 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 20:27:21.360350 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: from cryptography.utils import int_from_bytes Aug 22 20:27:21.361270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 20:27:21.361270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: from cryptography.utils import int_from_bytes Aug 22 20:27:21.448058 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 20:27:21.448360 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 20:27:21.448671 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] command line args: [] {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 20:27:21.449125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 20:27:21.449414 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ================================================================================ {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 20:27:21.449843 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] admin_token = **** {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.450257 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] config_dir = [] {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.450573 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.450879 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] config_source = [] {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.451218 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] debug = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.451591 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.452170 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.452485 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.452919 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.453354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.453747 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] list_limit = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.454063 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] log_config_append = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.454367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.454679 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] log_dir = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.454987 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] log_file = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.455395 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.455863 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.456292 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.456710 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.457034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.457318 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.457739 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.458160 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.458563 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.458955 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.459326 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.459729 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.460134 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.460538 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.461003 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.461823 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.462131 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] publish_errors = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.462540 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.462939 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.463242 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.463706 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.464116 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.464522 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] standard_threads = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.464919 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.465334 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.465635 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.465936 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] use_journal = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.466237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] use_json = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.466541 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] use_stderr = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.467363 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] use_syslog = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.467815 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.468253 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.468659 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.469106 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.469518 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.469943 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.470354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.470780 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.471190 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.471655 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.472090 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.472525 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.472928 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.473352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.473756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.474187 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.474612 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.475020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.475461 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.475934 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.476359 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.476764 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.477199 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.477656 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.478091 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.478528 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.478920 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.479309 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.479738 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.480134 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.480559 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.480978 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.481367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.481740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.482155 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.483145 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.483593 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.484008 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.484409 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.484811 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.485222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.485623 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.486021 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.486424 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.486831 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.487212 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.487671 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.488104 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.488547 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.488978 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.490681 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.491095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.491566 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.491970 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.492394 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.492810 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.493238 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.493722 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.494152 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.494554 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.494999 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.495407 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.495858 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.496259 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.496714 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.497136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.497542 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.497986 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.498408 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.498884 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.499305 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.499760 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.500198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.500606 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.501020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.501439 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.501865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.502287 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.502702 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.503122 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.503533 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.503970 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.504396 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.504806 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.505226 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.505676 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.506104 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.506526 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.506950 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.507374 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.507823 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.508237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.508645 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.509056 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.509452 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.509859 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.510273 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.510679 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.511097 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.511507 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.511980 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.512388 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.512809 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.513266 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.513725 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.514136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] auth.external = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.514547 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.515039 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.515445 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.515882 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] auth.password = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.516295 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] auth.token = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.516716 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.517132 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.517566 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.517973 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.518412 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.518844 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.519259 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.519706 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] credential.caching = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.520359 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.520787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.521217 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.521635 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.522070 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.522487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.522930 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.523396 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.523819 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.524258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.525283 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.525283 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.525672 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.526036 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.526486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.526929 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] federation.caching = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.527437 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.527795 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.528224 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.528632 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.529077 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.530025 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.530470 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.530840 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 20:27:21.530840 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: from cryptography.utils import int_from_bytes Aug 22 20:27:21.531722 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.531722 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.532064 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 20:27:21.532064 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: from cryptography.utils import int_from_bytes Aug 22 20:27:21.532399 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.532399 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.532755 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] identity.caching = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.532953 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.533346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.533742 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.534139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.534574 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.534972 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.535386 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.535851 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.536291 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.536691 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.537092 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.537785 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.537901 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.538327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.538761 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.539205 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.539660 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.540131 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.540549 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.540946 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.541344 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.541741 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.542132 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.542531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.542944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.543364 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.543820 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.544235 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.544668 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.545661 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.546091 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.546506 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.546934 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.547347 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.547792 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.548202 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.548608 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.549013 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.549432 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.549842 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.550260 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.550695 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.551122 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.551521 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.551963 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.552395 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.552835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.553243 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.553660 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.554342 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.554753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.user = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.555183 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.555661 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.556067 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.556504 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.556934 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.557372 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.557784 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.558182 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.558601 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.559009 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.559427 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.559857 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.560284 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.560758 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.561199 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.561636 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.562067 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.562472 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.562905 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.563318 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.563754 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.564169 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.564587 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.565015 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.565449 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.565863 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.566309 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.566711 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.567139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.567580 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.567986 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.568406 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.568836 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.569253 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.569657 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.570072 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.570484 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] resource.caching = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.570927 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.571358 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.571803 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.572240 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.572671 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.573085 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.573512 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.573925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.574345 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.574762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] role.caching = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.575192 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] role.driver = sql {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.575624 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.576062 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.576531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.576966 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.577403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.577842 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.578276 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.578707 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.579152 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.579577 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.580006 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.580446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.580885 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.581323 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.582111 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.582445 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.582866 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.583306 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.583770 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.584195 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.584607 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.585052 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.585475 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.585883 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.586289 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.586694 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.587103 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.587536 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.588002 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.588422 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.588837 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.589254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.589649 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.590060 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] token.caching = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.590476 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.590897 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.591302 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.592290 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.592723 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.593145 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.593565 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.593986 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.594405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.594814 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.595232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.595662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.596091 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.596513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.596898 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.597311 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.597798 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.598238 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] database.connection = **** {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.598650 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.599065 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.599468 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.599907 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.600314 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.600727 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.601119 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.601520 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.601937 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.602346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.602857 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.603166 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.603629 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.604028 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.604452 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.604839 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.605263 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.605692 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.605963 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 20:27:21.618131 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 20:27:21.618400 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 20:27:21.618621 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] command line args: [] {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 20:27:21.619068 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 20:27:21.619348 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ================================================================================ {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 20:27:21.619792 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] admin_token = **** {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.635925 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] config_dir = [] {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.635925 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.635925 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] config_source = [] {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.635925 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] debug = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.635925 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.635925 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.635925 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.636770 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.636770 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.636770 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] list_limit = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.636770 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] log_config_append = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.636770 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.636770 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] log_dir = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.636770 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] log_file = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.636770 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.636770 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.637692 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.637692 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.637692 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.637692 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.637692 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.637692 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.637692 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.638448 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.638448 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.638448 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.638448 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.638448 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.638448 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.638448 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.638448 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] publish_errors = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.638448 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.639411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.639411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.639411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.639411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.639411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] standard_threads = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.639411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.639411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.639411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.639411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] use_journal = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.640342 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] use_json = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.640342 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] use_stderr = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.640342 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] use_syslog = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.640342 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:27:21.640342 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.640342 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.640342 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.640342 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.640342 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.641323 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.641323 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.641323 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.641323 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.641323 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.641323 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.641323 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.641323 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.641323 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.642250 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.642250 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.642250 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.642250 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.642250 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.642250 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.642250 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.642250 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.642250 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.643194 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.643194 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.643194 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.643194 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.643194 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.643194 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.643194 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.643194 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.643194 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.643689 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.643689 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.643689 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.643689 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.643689 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.643689 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.643689 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.644048 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.644273 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.644675 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.645074 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.645464 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.645867 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.646281 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.646801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.647200 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.647597 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.647995 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.648378 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.648779 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.649156 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.649542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.649929 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.650322 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.650712 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.651109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.651504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.651972 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.652390 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.652816 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.653245 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.653696 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.654104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.655027 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.655433 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.655864 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.656503 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.656909 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.657336 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.657767 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.658173 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.658578 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.658984 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.659411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.659853 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.660257 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.660669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.661069 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.661493 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.661907 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.662308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.662711 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.663309 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.663767 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.664190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.664599 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.665020 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.665441 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.665856 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.666274 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.666679 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.667287 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.667700 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.668106 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.668508 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.668924 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.669323 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.669768 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.670796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.671169 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.671641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.672021 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:21.672110 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.672382 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:21.676079 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] auth.external = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.676246 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:21.676396 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.676396 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.676396 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.676396 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] auth.password = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.676396 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] auth.token = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.676396 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.676396 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.676396 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.676396 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.677184 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.677184 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.677424 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.677663 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] credential.caching = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.678071 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.678493 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.679174 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.679613 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.680036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.680448 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.680889 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.681322 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.681734 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.682180 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.682672 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.683098 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.683585 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.683998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.684422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.684825 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] federation.caching = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.685233 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.685698 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.686126 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.686520 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.686958 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.687389 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.687862 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.688271 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.688505 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:21.688697 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.689103 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.689531 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.689945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] identity.caching = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.690381 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.690804 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.691200 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.691626 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.692047 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.692496 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.692902 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.693325 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.693756 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.694151 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.694542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.694930 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.695336 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.695786 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.696206 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.696642 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.697065 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.697533 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.697953 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.698371 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.698762 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.699136 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.699497 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.699907 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.700325 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.700725 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.701658 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.702067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.702502 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.702931 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.703346 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.703803 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.704234 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.704636 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.705043 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.705447 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.705858 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.706247 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.706643 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.707038 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.707451 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.707896 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.708335 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.708742 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.709161 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.709707 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.710058 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.710457 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.710863 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.711253 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.711674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.user = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.712091 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.712530 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.712926 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.713344 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.713775 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.714219 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.714628 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.715025 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.715445 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.715874 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.716270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.716664 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.717734 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.718175 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.718591 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.719014 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.719465 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.719915 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.720342 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.720756 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.721164 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.721568 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.721958 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.731253 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.731253 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.731253 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.731253 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.731253 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.731253 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.731253 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.731253 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.731253 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.732327 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.732327 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.732327 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.732327 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.732327 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] resource.caching = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.732327 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.732327 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.732327 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.732327 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.733300 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.733300 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.733300 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.733300 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.733300 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.733300 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] role.caching = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.733300 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] role.driver = sql {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.733300 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.733300 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.734210 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.734210 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.734210 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.734540 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.734834 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.735262 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.735721 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.736123 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.736557 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.736991 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.737418 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.737891 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.738602 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.739006 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.739436 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.739892 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.740319 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.740752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.741156 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.741574 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.741708 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:21.741941 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:21.742058 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.742387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.742779 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.743181 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.743623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.744057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.744481 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.744898 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.745504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.745900 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.746296 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.746707 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] token.caching = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.747122 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.747564 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.747983 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.748471 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.748897 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.749633 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.749855 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.750269 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.750697 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.751121 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.751531 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.751960 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.752379 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.752797 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.753187 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.753599 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.754097 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.754536 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] database.connection = **** {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.754968 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.755385 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.755823 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.756457 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.756651 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.757057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.757464 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.757871 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.758300 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.758714 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.759143 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.759570 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.760022 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.760427 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.760854 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.761247 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.761674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.762090 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:27:21.762388 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 20:27:21.798740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:21.798997 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:21.799179 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:21.808930 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:21.811693 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:21.851027 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:21.851370 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:21.908798 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:21.909088 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:21.922821 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:21.989955 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:21.990324 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.026247 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.026611 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.026981 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.027337 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.027716 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.028068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.064962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.065309 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.065662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.066013 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.066365 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.066732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.068116 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.068486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.068850 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.069208 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.069553 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.069899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.070243 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.089780 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.090119 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.090434 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.090742 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.091057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.091360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.091718 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.095097 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.101492 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.109457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.109714 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.110018 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.110316 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.110609 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.110909 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.111200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.114063 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.114302 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.114571 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.114725 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.114925 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.115289 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.115507 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:27:22.130858 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.131106 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 20:27:22.131581 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.131684 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.131935 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 20:27:22.132242 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 20:27:22.132406 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.132490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.143915 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 20:27:22.144124 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.144266 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.144479 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.144623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.144784 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.144927 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.144927 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.145177 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.145317 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.145452 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.145604 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.145743 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.145743 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.145985 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.145985 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.152757 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.153526 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.156073 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.156380 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.156667 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.156836 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.156961 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.157109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.157240 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.157323 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.157485 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.157594 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.157758 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.157854 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.158035 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.158131 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.158309 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.158404 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.158581 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.158692 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.158906 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.159014 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.159157 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.159431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.182884 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.184516 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.184651 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.184820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.186756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.187046 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.190419 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.190726 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.212581 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.212805 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.212805 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.212805 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.213161 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.213161 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.213428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.213428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.213667 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.213667 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.213667 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.213667 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.214148 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.214281 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.214413 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.214541 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.214681 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.214812 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.214939 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.215073 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.215239 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.215239 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.215239 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.215239 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.221724 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.222025 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.222264 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.222570 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.226364 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.226578 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.229890 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.230122 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.230301 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.230433 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.234825 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.235057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.238119 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.238369 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.241569 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.247961 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.248660 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.248832 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.248978 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.249119 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.249233 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.249233 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.249524 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.249524 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.249767 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.249896 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.259919 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.260230 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.260507 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.260777 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.260926 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.261184 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.261469 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.261741 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.267674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.268665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.269344 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.269625 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.270445 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.270727 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.272360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.272652 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.272944 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.273241 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.273401 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.273536 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.273713 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.274001 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.274425 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.274720 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.286712 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.286934 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.287078 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.287211 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.293782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.293979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.294123 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.294254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.294375 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.294508 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.294652 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.294839 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.294998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.295128 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.304350 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.304542 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.307312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.307476 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.310405 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.311150 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.312436 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.312637 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.313922 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.314158 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.314244 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.314445 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.314580 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.314730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.321035 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.321422 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.322539 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.322912 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.325432 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.325732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.325851 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.326022 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.326245 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.327005 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.327126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.327325 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.335086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.335399 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.335713 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.336871 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.337182 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.337468 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.342696 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.343113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.343399 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.343735 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.344099 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.344311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.344454 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:27:22.344581 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.344848 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.344982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.345109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.345243 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.345365 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.345478 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.345672 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.345820 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.345955 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.346087 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.346221 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.346342 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.346447 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.346654 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.346772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.347004 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.347277 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.347567 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.347952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.348225 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:27:22.380228 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f84a87e9c0 pid: 88641 (default app) Aug 22 20:27:22.381947 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f84a87e9c0 pid: 88640 (default app) Aug 22 20:27:22.383929 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005da7c-2a80-4ae6-84aa-bec1d8e38414 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:22.384226 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005da7c-2a80-4ae6-84aa-bec1d8e38414 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:22.384505 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005da7c-2a80-4ae6-84aa-bec1d8e38414 None None] PATH_INFO: `/v3` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:22.389583 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Mon Aug 22 20:27:22 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:31.090145 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb718ba-a198-4bfd-a430-ff54ad9cdb8a None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:31.091238 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb718ba-a198-4bfd-a430-ff54ad9cdb8a None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:31.091238 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb718ba-a198-4bfd-a430-ff54ad9cdb8a None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:31.097849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:27:31 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:27:31.104262 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de538e2-8f50-49d9-a691-a7034301257e None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:31.104821 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de538e2-8f50-49d9-a691-a7034301257e None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:31.104821 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de538e2-8f50-49d9-a691-a7034301257e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:31.185259 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: INFO dbcounter [None req-0de538e2-8f50-49d9-a691-a7034301257e None None] Registered counter for database keystone Aug 22 20:27:31.209359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG oslo_db.sqlalchemy.engines [None req-0de538e2-8f50-49d9-a691-a7034301257e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 20:27:31.216020 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writer thread running {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 20:27:31.407270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG passlib.handlers.bcrypt [None req-0de538e2-8f50-49d9-a691-a7034301257e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88641) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 20:27:31.407637 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG passlib.handlers.bcrypt [None req-0de538e2-8f50-49d9-a691-a7034301257e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88641) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 20:27:31.465675 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-0de538e2-8f50-49d9-a691-a7034301257e None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:31.467582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-0de538e2-8f50-49d9-a691-a7034301257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:31.656794 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 554 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 22 20:27:32.190661 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb718ba-a198-4bfd-a430-ff54ad9cdb8a None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:32.268587 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: INFO dbcounter [None req-3bb718ba-a198-4bfd-a430-ff54ad9cdb8a None None] Registered counter for database keystone Aug 22 20:27:32.289193 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG oslo_db.sqlalchemy.engines [None req-3bb718ba-a198-4bfd-a430-ff54ad9cdb8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 20:27:32.296623 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writer thread running {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 20:27:32.420864 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb718ba-a198-4bfd-a430-ff54ad9cdb8a None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:32.427052 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29512f0-90b4-4840-a148-b06069bf532c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:32.428139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29512f0-90b4-4840-a148-b06069bf532c admin admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:32.428580 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29512f0-90b4-4840-a148-b06069bf532c admin admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:32.429031 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29512f0-90b4-4840-a148-b06069bf532c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:32.444912 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29512f0-90b4-4840-a148-b06069bf532c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:32.553409 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f29512f0-90b4-4840-a148-b06069bf532c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 20:27:32.554009 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29512f0-90b4-4840-a148-b06069bf532c admin admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:32.572057 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Aug 22 20:27:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 22 20:27:32.578862 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de538e2-8f50-49d9-a691-a7034301257e None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:32.594883 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de538e2-8f50-49d9-a691-a7034301257e None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:32.599444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35557778-7984-4280-8e3e-db5d5f5aa7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:32.600631 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35557778-7984-4280-8e3e-db5d5f5aa7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:32.600915 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35557778-7984-4280-8e3e-db5d5f5aa7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:32.601191 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35557778-7984-4280-8e3e-db5d5f5aa7f0 admin admin] PATH_INFO: `/v3/projects/41d17f0c019c419fa2ba2277c76a76b5` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:32.602887 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35557778-7984-4280-8e3e-db5d5f5aa7f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=41d17f0c019c419fa2ba2277c76a76b5)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:32.655849 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: WARNING keystone.common.rbac_enforcer.enforcer [None req-35557778-7984-4280-8e3e-db5d5f5aa7f0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 20:27:32.656188 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35557778-7984-4280-8e3e-db5d5f5aa7f0 admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:32.660926 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Aug 22 20:27:32 2022] GET /identity/v3/projects/41d17f0c019c419fa2ba2277c76a76b5 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:35.001914 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af55af-2824-467b-b01e-2cd5edecadd5 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:35.002469 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af55af-2824-467b-b01e-2cd5edecadd5 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:35.002469 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af55af-2824-467b-b01e-2cd5edecadd5 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:35.006739 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:27:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:27:35.016199 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f8a23-b0d2-4e99-bdd2-43093947adaf None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:35.016749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f8a23-b0d2-4e99-bdd2-43093947adaf None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:35.016749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f8a23-b0d2-4e99-bdd2-43093947adaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:35.039578 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-494f8a23-b0d2-4e99-bdd2-43093947adaf None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:35.042477 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-494f8a23-b0d2-4e99-bdd2-43093947adaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:35.056732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 22 20:27:35.395149 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af55af-2824-467b-b01e-2cd5edecadd5 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:35.407813 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af55af-2824-467b-b01e-2cd5edecadd5 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:35.412133 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8ba91-b9b7-4cb7-8abf-df19f48b1101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:35.412789 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8ba91-b9b7-4cb7-8abf-df19f48b1101 admin admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:35.413108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8ba91-b9b7-4cb7-8abf-df19f48b1101 admin admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:35.413422 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8ba91-b9b7-4cb7-8abf-df19f48b1101 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:35.422594 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8ba91-b9b7-4cb7-8abf-df19f48b1101 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:35.426429 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8ba91-b9b7-4cb7-8abf-df19f48b1101 admin admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:35.437366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Aug 22 20:27:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 22 20:27:35.443488 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f8a23-b0d2-4e99-bdd2-43093947adaf None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:35.453422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f8a23-b0d2-4e99-bdd2-43093947adaf None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:35.458546 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f97e18-035c-4657-bbb4-e21b23705b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:35.459305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f97e18-035c-4657-bbb4-e21b23705b65 admin admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:35.459724 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f97e18-035c-4657-bbb4-e21b23705b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:35.460086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f97e18-035c-4657-bbb4-e21b23705b65 admin admin] PATH_INFO: `/v3/users/146ec9a584bf4142acfd366d51db1f8d` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:35.461577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f97e18-035c-4657-bbb4-e21b23705b65 admin admin] RBAC: Authorizing `identity:get_user(user_id=146ec9a584bf4142acfd366d51db1f8d)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:35.463578 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f97e18-035c-4657-bbb4-e21b23705b65 admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:35.465289 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Aug 22 20:27:35 2022] GET /identity/v3/users/146ec9a584bf4142acfd366d51db1f8d => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:37.837920 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ececb64-3c0d-4ca0-9f2e-a4c911a5732a None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:37.838478 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ececb64-3c0d-4ca0-9f2e-a4c911a5732a None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:37.838817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ececb64-3c0d-4ca0-9f2e-a4c911a5732a None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:37.841142 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:27:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:37.849586 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bba0a-49cf-429a-8642-a22b5bfcb52d None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:37.850331 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bba0a-49cf-429a-8642-a22b5bfcb52d None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:37.850645 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bba0a-49cf-429a-8642-a22b5bfcb52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:37.870478 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb706be0-ab6e-4591-99cc-3488b5c69606 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:37.870767 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb706be0-ab6e-4591-99cc-3488b5c69606 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:37.871008 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-b15bba0a-49cf-429a-8642-a22b5bfcb52d None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:37.871137 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb706be0-ab6e-4591-99cc-3488b5c69606 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:37.872330 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-b15bba0a-49cf-429a-8642-a22b5bfcb52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:37.873085 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:27:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:27:37.887911 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986e010-274b-469f-8313-0a336df55860 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:37.888311 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986e010-274b-469f-8313-0a336df55860 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:37.888724 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986e010-274b-469f-8313-0a336df55860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:37.933693 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG passlib.handlers.bcrypt [None req-6986e010-274b-469f-8313-0a336df55860 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88640) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 20:27:37.934120 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG passlib.handlers.bcrypt [None req-6986e010-274b-469f-8313-0a336df55860 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88640) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 20:27:37.980402 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-6986e010-274b-469f-8313-0a336df55860 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:37.982072 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-6986e010-274b-469f-8313-0a336df55860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:37.985843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:27:38.096556 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:27:38.331494 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bba0a-49cf-429a-8642-a22b5bfcb52d None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:38.375689 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:38.425113 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986e010-274b-469f-8313-0a336df55860 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:38.503694 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bba0a-49cf-429a-8642-a22b5bfcb52d None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:38.556464 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184adc14-8c64-4720-ba1c-21de8c1f8d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:38.557283 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184adc14-8c64-4720-ba1c-21de8c1f8d8c None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:38.557650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184adc14-8c64-4720-ba1c-21de8c1f8d8c None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:38.558011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184adc14-8c64-4720-ba1c-21de8c1f8d8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:38.572942 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986e010-274b-469f-8313-0a336df55860 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:38.573240 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184adc14-8c64-4720-ba1c-21de8c1f8d8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:27:38.575785 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:38.583914 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-184adc14-8c64-4720-ba1c-21de8c1f8d8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:27:38.583914 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:38.583914 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:38.583914 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:38.583914 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:38.583914 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:38.583914 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:38.583914 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:38.583914 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:38.583914 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:38.583914 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:38.583914 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:38.583914 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:27:38.583914 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:27:38.583914 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:27:38.583914 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:27:38.584918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:27:38.584918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:27:38.584918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:27:38.584918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:27:38.584918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:38.584918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:38.584918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:38.584918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:38.584918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:38.584918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:38.584918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:38.584918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:38.584918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:38.584918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:38.584918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:38.584918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:38.585861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:38.585861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:38.585861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:38.585861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:38.585861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:27:38.585861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:27:38.585861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:27:38.585861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:27:38.585861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:27:38.585861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:27:38.585861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:27:38.585861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:27:38.586451 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 20:27:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:38.593585 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184adc14-8c64-4720-ba1c-21de8c1f8d8c None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:38.630865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b0173-e28d-48c7-a5ed-5cbb5feb66f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:38.632052 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b0173-e28d-48c7-a5ed-5cbb5feb66f2 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:38.632515 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b0173-e28d-48c7-a5ed-5cbb5feb66f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:38.632931 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b0173-e28d-48c7-a5ed-5cbb5feb66f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:38.722759 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:38.745493 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b0173-e28d-48c7-a5ed-5cbb5feb66f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:38.747734 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184adc14-8c64-4720-ba1c-21de8c1f8d8c None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:38.748238 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b0173-e28d-48c7-a5ed-5cbb5feb66f2 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:38.900687 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 8/15] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:27:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 20:27:38.906988 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b0173-e28d-48c7-a5ed-5cbb5feb66f2 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:38.910130 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:38.940266 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb0e22-bb54-405d-b5d9-c71384d4548d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:38.940958 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb0e22-bb54-405d-b5d9-c71384d4548d None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:38.941152 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb0e22-bb54-405d-b5d9-c71384d4548d None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:38.941423 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb0e22-bb54-405d-b5d9-c71384d4548d None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:38.942104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb0e22-bb54-405d-b5d9-c71384d4548d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:38.942406 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb0e22-bb54-405d-b5d9-c71384d4548d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:38.943838 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb0e22-bb54-405d-b5d9-c71384d4548d None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:38.956887 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 8/16] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:27:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:38.962867 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb0e22-bb54-405d-b5d9-c71384d4548d None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:39.025912 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b0173-e28d-48c7-a5ed-5cbb5feb66f2 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:39.067952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540af2d-d8ea-4e8c-8ae1-4295b3a7d1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:39.068843 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540af2d-d8ea-4e8c-8ae1-4295b3a7d1c5 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:39.069192 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540af2d-d8ea-4e8c-8ae1-4295b3a7d1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:39.069476 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540af2d-d8ea-4e8c-8ae1-4295b3a7d1c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:39.087672 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb0e22-bb54-405d-b5d9-c71384d4548d None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:39.090886 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540af2d-d8ea-4e8c-8ae1-4295b3a7d1c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:39.092512 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540af2d-d8ea-4e8c-8ae1-4295b3a7d1c5 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:39.116483 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-f540af2d-d8ea-4e8c-8ae1-4295b3a7d1c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:39.116483 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:39.116483 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:39.116483 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:39.116483 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:39.116483 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:39.116483 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:39.116483 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:39.116483 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:39.116483 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:39.116483 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:39.116483 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:39.116483 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:27:39.116483 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:27:39.116483 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:27:39.116483 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:27:39.118382 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:39.118382 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:39.118382 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:39.118382 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:39.118382 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:39.118382 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:39.118382 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:39.118382 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:39.118382 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:39.118382 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:39.118382 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:39.118382 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:39.118382 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:39.118382 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:39.118382 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:39.118382 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:39.118382 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:27:39.120219 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:27:39.120219 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:39.120219 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:27:39.120219 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 9/17] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:39.124370 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540af2d-d8ea-4e8c-8ae1-4295b3a7d1c5 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:39.135668 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e2296-4229-47e0-b4d2-46641b08b481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:39.136336 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e2296-4229-47e0-b4d2-46641b08b481 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:39.136616 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e2296-4229-47e0-b4d2-46641b08b481 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:39.136891 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e2296-4229-47e0-b4d2-46641b08b481 None admin] PATH_INFO: `/v3/users/146ec9a584bf4142acfd366d51db1f8d` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:39.138822 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e2296-4229-47e0-b4d2-46641b08b481 None admin] RBAC: Authorizing `identity:get_user(user_id=146ec9a584bf4142acfd366d51db1f8d)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:39.141963 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e2296-4229-47e0-b4d2-46641b08b481 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:39.145126 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 9/18] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:27:38 2022] GET /identity/v3/users/146ec9a584bf4142acfd366d51db1f8d => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:39.154314 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e2296-4229-47e0-b4d2-46641b08b481 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:39.176470 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:39.291691 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e2296-4229-47e0-b4d2-46641b08b481 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:39.312749 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:39.336127 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda5111-9c6c-41a5-a0cc-ddd043ebd59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:39.336860 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda5111-9c6c-41a5-a0cc-ddd043ebd59c None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:39.337236 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda5111-9c6c-41a5-a0cc-ddd043ebd59c None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:39.337604 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda5111-9c6c-41a5-a0cc-ddd043ebd59c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:39.338968 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda5111-9c6c-41a5-a0cc-ddd043ebd59c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:39.340603 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda5111-9c6c-41a5-a0cc-ddd043ebd59c None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:39.343157 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 10/19] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:39.349273 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda5111-9c6c-41a5-a0cc-ddd043ebd59c None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:39.369048 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540af2d-d8ea-4e8c-8ae1-4295b3a7d1c5 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:39.419367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66febc-b55b-4ea5-aec8-666beb1a75de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:39.420067 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66febc-b55b-4ea5-aec8-666beb1a75de None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:39.420525 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66febc-b55b-4ea5-aec8-666beb1a75de None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:39.420896 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66febc-b55b-4ea5-aec8-666beb1a75de None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:39.421670 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66febc-b55b-4ea5-aec8-666beb1a75de None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:39.422066 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66febc-b55b-4ea5-aec8-666beb1a75de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:39.423805 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66febc-b55b-4ea5-aec8-666beb1a75de None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:39.445879 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 10/20] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:39.463782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:39.488168 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda5111-9c6c-41a5-a0cc-ddd043ebd59c None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:39.537784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556f7ac-0bbf-4d1f-abd1-69866a827ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:39.538646 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556f7ac-0bbf-4d1f-abd1-69866a827ecc None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:39.539030 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556f7ac-0bbf-4d1f-abd1-69866a827ecc None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:39.539406 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556f7ac-0bbf-4d1f-abd1-69866a827ecc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:39.540307 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556f7ac-0bbf-4d1f-abd1-69866a827ecc None admin] RBAC: Adding query filter params (role.id=1e3ce9c8b9934a7bb515b39e21fc1d68, scope.domain.id=default, user.id=146ec9a584bf4142acfd366d51db1f8d) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:39.540704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556f7ac-0bbf-4d1f-abd1-69866a827ecc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:39.542384 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556f7ac-0bbf-4d1f-abd1-69866a827ecc None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:39.551718 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 11/21] 10.222.0.15 () {56 vars in 1322 bytes} [Mon Aug 22 20:27:39 2022] GET /identity/v3/role_assignments?user.id=146ec9a584bf4142acfd366d51db1f8d&scope.domain.id=default&role.id=1e3ce9c8b9934a7bb515b39e21fc1d68 => generated 233 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:42.387823 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a699550-99b9-4d33-9896-8e9f8ed2cabb None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:42.388583 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a699550-99b9-4d33-9896-8e9f8ed2cabb None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:42.388583 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a699550-99b9-4d33-9896-8e9f8ed2cabb None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:42.389840 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 11/22] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:42.395747 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91985357-87af-4022-9b15-13e048c05476 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:42.396457 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91985357-87af-4022-9b15-13e048c05476 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:42.396457 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91985357-87af-4022-9b15-13e048c05476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:42.424330 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-91985357-87af-4022-9b15-13e048c05476 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:42.425594 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-91985357-87af-4022-9b15-13e048c05476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:42.524826 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 12/23] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:27:43.086775 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aba91c-d9e2-47c9-ac0e-e76f1159b11a None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:43.087149 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aba91c-d9e2-47c9-ac0e-e76f1159b11a None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:43.087397 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aba91c-d9e2-47c9-ac0e-e76f1159b11a None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:43.088953 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 12/24] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:43.094884 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb2c9c-c4f2-4bb3-8faf-c385fbfc59fc None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:43.095178 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb2c9c-c4f2-4bb3-8faf-c385fbfc59fc None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:43.095463 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb2c9c-c4f2-4bb3-8faf-c385fbfc59fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:43.120152 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-4cdb2c9c-c4f2-4bb3-8faf-c385fbfc59fc None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:43.121391 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-4cdb2c9c-c4f2-4bb3-8faf-c385fbfc59fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:43.141627 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aba91c-d9e2-47c9-ac0e-e76f1159b11a None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:43.313533 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 13/25] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:27:43.329541 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aba91c-d9e2-47c9-ac0e-e76f1159b11a None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:43.360029 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:43.388004 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c9e47-d108-4803-a9ae-581d4418c793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:43.389596 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c9e47-d108-4803-a9ae-581d4418c793 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:43.390112 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c9e47-d108-4803-a9ae-581d4418c793 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:43.390643 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c9e47-d108-4803-a9ae-581d4418c793 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:43.414232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c9e47-d108-4803-a9ae-581d4418c793 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:27:43.427503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-ef6c9e47-d108-4803-a9ae-581d4418c793 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:27:43.427503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:43.427503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:43.427503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:43.427503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:43.427503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:43.427503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:43.427503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:43.427503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:43.427503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:43.427503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:43.427503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:43.427503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:27:43.427503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:27:43.427503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:27:43.427503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:27:43.428441 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:27:43.428441 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:27:43.428441 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:27:43.428441 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:27:43.428441 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:43.428441 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:43.428441 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:43.428441 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:43.428441 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:43.428441 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:43.428441 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:43.428441 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:43.428441 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:43.428441 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:43.428441 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:43.428441 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:43.429198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:43.429198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:43.429198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:43.429198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:43.429198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:27:43.429198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:27:43.429198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:27:43.429198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:27:43.429198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:27:43.429198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:27:43.429198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:27:43.429198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:27:43.430325 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 13/26] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 20:27:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:43.435961 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb2c9c-c4f2-4bb3-8faf-c385fbfc59fc None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:43.440424 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:43.506678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9209ee4-ca71-4e32-bca4-d96be6f3406a None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:43.507330 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9209ee4-ca71-4e32-bca4-d96be6f3406a None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:43.507856 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9209ee4-ca71-4e32-bca4-d96be6f3406a None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:43.509705 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 14/27] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:27:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:27:43.515957 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651e838-b0e5-4ed2-8603-5bbc0d7284d3 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:43.516604 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651e838-b0e5-4ed2-8603-5bbc0d7284d3 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:43.517100 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651e838-b0e5-4ed2-8603-5bbc0d7284d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:43.564953 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-c651e838-b0e5-4ed2-8603-5bbc0d7284d3 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:43.566211 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-c651e838-b0e5-4ed2-8603-5bbc0d7284d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:43.577898 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb2c9c-c4f2-4bb3-8faf-c385fbfc59fc None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:43.643004 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df558a-1eaa-4243-84a3-08a67785ee29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:43.643916 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df558a-1eaa-4243-84a3-08a67785ee29 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:43.644352 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df558a-1eaa-4243-84a3-08a67785ee29 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:43.644767 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df558a-1eaa-4243-84a3-08a67785ee29 None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:43.645703 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df558a-1eaa-4243-84a3-08a67785ee29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:43.646185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df558a-1eaa-4243-84a3-08a67785ee29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:43.647797 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df558a-1eaa-4243-84a3-08a67785ee29 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:43.664678 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 14/28] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:27:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:43.670406 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea860ef-2097-4765-88b4-2ea7b577ce31 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:43.671218 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea860ef-2097-4765-88b4-2ea7b577ce31 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:43.671502 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea860ef-2097-4765-88b4-2ea7b577ce31 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:43.672880 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 15/29] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:43.680039 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea860ef-2097-4765-88b4-2ea7b577ce31 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:43.682368 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 15/30] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:27:43.685886 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746a808-55c7-4dff-bf88-f7c2a090f03b None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:43.687119 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746a808-55c7-4dff-bf88-f7c2a090f03b None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:43.687707 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746a808-55c7-4dff-bf88-f7c2a090f03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:43.723766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-b746a808-55c7-4dff-bf88-f7c2a090f03b None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:43.726322 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-b746a808-55c7-4dff-bf88-f7c2a090f03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:43.838948 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:43.854882 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 16/31] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:27:43.887766 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea860ef-2097-4765-88b4-2ea7b577ce31 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:43.960009 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746a808-55c7-4dff-bf88-f7c2a090f03b None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:43.975964 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e34d6-b9d8-43b9-af71-f2e258db5e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:43.977387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e34d6-b9d8-43b9-af71-f2e258db5e57 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:43.978067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e34d6-b9d8-43b9-af71-f2e258db5e57 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:43.978778 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e34d6-b9d8-43b9-af71-f2e258db5e57 None admin] PATH_INFO: `/v3/users/146ec9a584bf4142acfd366d51db1f8d` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:43.980869 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e34d6-b9d8-43b9-af71-f2e258db5e57 None admin] RBAC: Authorizing `identity:get_user(user_id=146ec9a584bf4142acfd366d51db1f8d)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:43.988279 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e34d6-b9d8-43b9-af71-f2e258db5e57 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:43.993893 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 16/32] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:27:43 2022] GET /identity/v3/users/146ec9a584bf4142acfd366d51db1f8d => generated 247 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:44.005020 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e34d6-b9d8-43b9-af71-f2e258db5e57 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:44.025810 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:44.104072 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746a808-55c7-4dff-bf88-f7c2a090f03b None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:44.151423 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105288b-4eb9-4be3-b29b-53b672f58679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:44.152179 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105288b-4eb9-4be3-b29b-53b672f58679 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:44.152464 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105288b-4eb9-4be3-b29b-53b672f58679 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:44.152739 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105288b-4eb9-4be3-b29b-53b672f58679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:44.170645 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105288b-4eb9-4be3-b29b-53b672f58679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:44.172253 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105288b-4eb9-4be3-b29b-53b672f58679 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:44.194753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-8105288b-4eb9-4be3-b29b-53b672f58679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:44.194753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:44.194753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:44.194753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:44.194753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:44.194753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:44.194753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:44.194753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:44.194753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:44.194753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:44.194753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:44.194753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:44.194753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:27:44.194753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:27:44.194753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:27:44.194753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:27:44.195703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:44.195703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:44.195703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:44.195703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:44.195703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:44.195703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:44.195703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:44.195703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:44.195703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:44.195703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:44.195703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:44.195703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:44.195703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:44.195703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:44.195703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:44.195703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:44.195703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:27:44.196498 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:27:44.196498 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:44.196498 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:27:44.203837 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 17/33] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:44.211372 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105288b-4eb9-4be3-b29b-53b672f58679 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:44.289880 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e34d6-b9d8-43b9-af71-f2e258db5e57 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:44.377269 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83154a8-ac57-4bea-b8e6-abedc80d2f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:44.377954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83154a8-ac57-4bea-b8e6-abedc80d2f51 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:44.378315 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83154a8-ac57-4bea-b8e6-abedc80d2f51 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:44.378597 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83154a8-ac57-4bea-b8e6-abedc80d2f51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:44.379846 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83154a8-ac57-4bea-b8e6-abedc80d2f51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:44.381350 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83154a8-ac57-4bea-b8e6-abedc80d2f51 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:44.382986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 17/34] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:44.383775 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83154a8-ac57-4bea-b8e6-abedc80d2f51 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:44.391916 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:44.396898 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:44.421450 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105288b-4eb9-4be3-b29b-53b672f58679 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:44.472568 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257822e-f1f1-413e-a721-c630aa81c136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:44.473456 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257822e-f1f1-413e-a721-c630aa81c136 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:44.473772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257822e-f1f1-413e-a721-c630aa81c136 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:44.474091 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257822e-f1f1-413e-a721-c630aa81c136 None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:44.475045 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257822e-f1f1-413e-a721-c630aa81c136 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:44.475476 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257822e-f1f1-413e-a721-c630aa81c136 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:44.478082 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257822e-f1f1-413e-a721-c630aa81c136 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:44.500782 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 18/35] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:44.502424 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257822e-f1f1-413e-a721-c630aa81c136 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:44.556294 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83154a8-ac57-4bea-b8e6-abedc80d2f51 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:44.597671 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab16cb-56cf-4f5a-926e-a360b9a094f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:44.598605 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab16cb-56cf-4f5a-926e-a360b9a094f0 None admin] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:44.598892 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab16cb-56cf-4f5a-926e-a360b9a094f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:44.599169 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab16cb-56cf-4f5a-926e-a360b9a094f0 None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:44.599888 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab16cb-56cf-4f5a-926e-a360b9a094f0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:44.601315 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab16cb-56cf-4f5a-926e-a360b9a094f0 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:44.634439 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257822e-f1f1-413e-a721-c630aa81c136 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:44.674595 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a052487-a74b-47d5-935e-4dbb63a3dcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:44.675264 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a052487-a74b-47d5-935e-4dbb63a3dcba None admin] REQUEST_METHOD: `PUT` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:44.675568 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a052487-a74b-47d5-935e-4dbb63a3dcba None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:44.675929 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a052487-a74b-47d5-935e-4dbb63a3dcba None admin] PATH_INFO: `/v3/domains/default/users/146ec9a584bf4142acfd366d51db1f8d/roles/1e3ce9c8b9934a7bb515b39e21fc1d68` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:44.678408 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a052487-a74b-47d5-935e-4dbb63a3dcba None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=146ec9a584bf4142acfd366d51db1f8d, role_id=1e3ce9c8b9934a7bb515b39e21fc1d68)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:44.679926 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a052487-a74b-47d5-935e-4dbb63a3dcba None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:44.823601 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 18/36] 10.222.0.15 () {60 vars in 1131 bytes} [Mon Aug 22 20:27:44 2022] POST /identity/v3/roles => generated 219 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:27:44.824735 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab16cb-56cf-4f5a-926e-a360b9a094f0 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:44.912508 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:44.943584 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 19/37] 10.222.0.15 () {58 vars in 1361 bytes} [Mon Aug 22 20:27:44 2022] PUT /identity/v3/domains/default/users/146ec9a584bf4142acfd366d51db1f8d/roles/1e3ce9c8b9934a7bb515b39e21fc1d68 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:27:44.943584 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a052487-a74b-47d5-935e-4dbb63a3dcba None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:44.950170 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:44.997431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab16cb-56cf-4f5a-926e-a360b9a094f0 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:45.052091 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb76feb-e1c6-433d-89f4-79de9dabf520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:45.052746 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb76feb-e1c6-433d-89f4-79de9dabf520 None admin] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:45.053069 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb76feb-e1c6-433d-89f4-79de9dabf520 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:45.053357 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb76feb-e1c6-433d-89f4-79de9dabf520 None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:45.054064 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb76feb-e1c6-433d-89f4-79de9dabf520 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:45.056861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb76feb-e1c6-433d-89f4-79de9dabf520 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:45.091926 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a052487-a74b-47d5-935e-4dbb63a3dcba None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:45.142127 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1ff41-a9d0-4050-8565-9453b7a2c1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:45.142746 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1ff41-a9d0-4050-8565-9453b7a2c1cb None admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:45.143037 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1ff41-a9d0-4050-8565-9453b7a2c1cb None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:45.143318 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1ff41-a9d0-4050-8565-9453b7a2c1cb None admin] PATH_INFO: `/v3/projects` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:45.144035 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1ff41-a9d0-4050-8565-9453b7a2c1cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:45.145743 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1ff41-a9d0-4050-8565-9453b7a2c1cb None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:45.198584 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 19/38] 10.222.0.15 () {60 vars in 1131 bytes} [Mon Aug 22 20:27:44 2022] POST /identity/v3/roles => generated 225 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:27:45.200153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c25dd3-f210-4586-b39f-22cdeedba6c1 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:45.200451 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c25dd3-f210-4586-b39f-22cdeedba6c1 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:45.200751 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c25dd3-f210-4586-b39f-22cdeedba6c1 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:45.202943 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 20/39] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:45.204845 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22c5a3-2dce-4c59-8d58-f301434a9e85 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:45.205191 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22c5a3-2dce-4c59-8d58-f301434a9e85 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:45.205585 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22c5a3-2dce-4c59-8d58-f301434a9e85 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:45.207732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 21/40] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:45.209268 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd358a11-89c2-4155-844c-0570297ffa11 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:45.209570 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd358a11-89c2-4155-844c-0570297ffa11 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:45.209919 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd358a11-89c2-4155-844c-0570297ffa11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:45.236608 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-cd358a11-89c2-4155-844c-0570297ffa11 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:45.238231 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-cd358a11-89c2-4155-844c-0570297ffa11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:45.274273 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 20:27:44 2022] POST /identity/v3/projects => generated 301 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:27:45.276781 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd53d2-1365-40ab-a09e-a0dc3e7921d0 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:45.277840 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd53d2-1365-40ab-a09e-a0dc3e7921d0 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:45.278413 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd53d2-1365-40ab-a09e-a0dc3e7921d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:45.304654 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-1ccd53d2-1365-40ab-a09e-a0dc3e7921d0 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:45.308331 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-1ccd53d2-1365-40ab-a09e-a0dc3e7921d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:45.360571 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 22/42] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:27:45.389392 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:45.402277 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 21/43] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:27:45.738637 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd358a11-89c2-4155-844c-0570297ffa11 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:45.748440 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd53d2-1365-40ab-a09e-a0dc3e7921d0 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:45.814635 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:45.878474 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd358a11-89c2-4155-844c-0570297ffa11 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:45.881060 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd53d2-1365-40ab-a09e-a0dc3e7921d0 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:45.922807 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66162ee9-a2de-4a69-82c9-0557dfa17c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:45.923656 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66162ee9-a2de-4a69-82c9-0557dfa17c5c None admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:45.923941 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66162ee9-a2de-4a69-82c9-0557dfa17c5c None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:45.924452 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66162ee9-a2de-4a69-82c9-0557dfa17c5c None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:45.925108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66162ee9-a2de-4a69-82c9-0557dfa17c5c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:45.926760 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66162ee9-a2de-4a69-82c9-0557dfa17c5c None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:45.929525 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c676b6-65d4-4bb3-bfd2-2d245928433b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:45.930163 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c676b6-65d4-4bb3-bfd2-2d245928433b None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:45.930454 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c676b6-65d4-4bb3-bfd2-2d245928433b None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:45.930986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c676b6-65d4-4bb3-bfd2-2d245928433b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:45.932236 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c676b6-65d4-4bb3-bfd2-2d245928433b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:45.933729 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c676b6-65d4-4bb3-bfd2-2d245928433b None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:45.935350 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 23/44] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:45.941810 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c676b6-65d4-4bb3-bfd2-2d245928433b None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:46.049669 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1131 bytes} [Mon Aug 22 20:27:45 2022] POST /identity/v3/roles => generated 223 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:27:46.081314 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c676b6-65d4-4bb3-bfd2-2d245928433b None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:46.114634 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:46.133117 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37b404-7a7a-46f3-bbd6-6b4e647cc1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:46.133767 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37b404-7a7a-46f3-bbd6-6b4e647cc1e0 None admin] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:46.134069 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37b404-7a7a-46f3-bbd6-6b4e647cc1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:46.134324 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37b404-7a7a-46f3-bbd6-6b4e647cc1e0 None admin] PATH_INFO: `/v3/projects` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:46.135026 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37b404-7a7a-46f3-bbd6-6b4e647cc1e0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:46.136621 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37b404-7a7a-46f3-bbd6-6b4e647cc1e0 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:46.258835 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 20:27:45 2022] POST /identity/v3/projects => generated 312 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:27:47.330985 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0040b-c389-4273-8246-444aa7c2eb0c None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:47.331500 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0040b-c389-4273-8246-444aa7c2eb0c None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:47.332032 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0040b-c389-4273-8246-444aa7c2eb0c None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:47.333868 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 23/47] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:47.341379 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0505e9-e315-4643-a23a-91296f0f2db2 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:47.341889 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0505e9-e315-4643-a23a-91296f0f2db2 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:47.341975 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0505e9-e315-4643-a23a-91296f0f2db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:47.363120 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-de0505e9-e315-4643-a23a-91296f0f2db2 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:47.364412 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-de0505e9-e315-4643-a23a-91296f0f2db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:47.443349 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 25/48] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:27:47.783893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0040b-c389-4273-8246-444aa7c2eb0c None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:47.843016 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:47.900306 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0040b-c389-4273-8246-444aa7c2eb0c None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:47.940287 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb89ff-e757-46af-84af-24d49908dec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:47.941061 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb89ff-e757-46af-84af-24d49908dec3 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:47.941435 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb89ff-e757-46af-84af-24d49908dec3 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:47.941799 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb89ff-e757-46af-84af-24d49908dec3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:47.954920 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb89ff-e757-46af-84af-24d49908dec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:27:47.961487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-38bb89ff-e757-46af-84af-24d49908dec3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:27:47.961487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:47.961487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:47.961487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:47.961487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:47.961487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:47.961487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:47.961487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:47.961487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:47.961487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:47.961487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:47.961487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:47.961487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:27:47.961487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:27:47.961487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:27:47.961487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:27:47.963174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:27:47.963174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:27:47.963174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:27:47.963174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:27:47.963174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:47.963174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:47.963174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:47.963174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:47.963174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:47.963174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:47.963174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:47.963174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:47.963174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:47.963174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:47.963174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:47.963174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:47.964648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:47.964648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:47.964648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:47.964648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:47.964648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:27:47.964648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:27:47.964648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:27:47.964648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:27:47.964648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:27:47.964648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:27:47.964648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:27:47.964648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:27:47.964648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 24/49] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 20:27:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:47.971083 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0505e9-e315-4643-a23a-91296f0f2db2 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:48.090163 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0505e9-e315-4643-a23a-91296f0f2db2 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:48.092293 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:48.132070 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d9560-3ea1-401a-b0ea-c1ecbfa2fe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:48.132752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d9560-3ea1-401a-b0ea-c1ecbfa2fe9d None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:48.133085 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d9560-3ea1-401a-b0ea-c1ecbfa2fe9d None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:48.133414 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d9560-3ea1-401a-b0ea-c1ecbfa2fe9d None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:48.134239 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d9560-3ea1-401a-b0ea-c1ecbfa2fe9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:48.134597 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d9560-3ea1-401a-b0ea-c1ecbfa2fe9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:48.136099 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d9560-3ea1-401a-b0ea-c1ecbfa2fe9d None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:48.145516 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 26/50] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:27:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:48.151814 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb89ff-e757-46af-84af-24d49908dec3 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:48.267297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb89ff-e757-46af-84af-24d49908dec3 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:48.279151 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:48.308881 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a9eb6-eb57-4729-9f01-13f28e72aeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:48.309656 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a9eb6-eb57-4729-9f01-13f28e72aeae None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:48.310031 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a9eb6-eb57-4729-9f01-13f28e72aeae None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:48.310448 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a9eb6-eb57-4729-9f01-13f28e72aeae None admin] PATH_INFO: `/v3/users/146ec9a584bf4142acfd366d51db1f8d` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:48.312329 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a9eb6-eb57-4729-9f01-13f28e72aeae None admin] RBAC: Authorizing `identity:get_user(user_id=146ec9a584bf4142acfd366d51db1f8d)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:48.313921 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a9eb6-eb57-4729-9f01-13f28e72aeae None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:48.315660 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 25/51] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:27:48 2022] GET /identity/v3/users/146ec9a584bf4142acfd366d51db1f8d => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:48.321689 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d9560-3ea1-401a-b0ea-c1ecbfa2fe9d None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:48.450496 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d9560-3ea1-401a-b0ea-c1ecbfa2fe9d None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:48.487332 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695c4cf-c0a2-443c-a88d-5361bd785d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:48.488186 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695c4cf-c0a2-443c-a88d-5361bd785d49 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:48.488544 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695c4cf-c0a2-443c-a88d-5361bd785d49 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:48.488924 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695c4cf-c0a2-443c-a88d-5361bd785d49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:48.490193 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695c4cf-c0a2-443c-a88d-5361bd785d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:48.491854 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695c4cf-c0a2-443c-a88d-5361bd785d49 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:48.494403 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 27/52] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:48.501404 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a9eb6-eb57-4729-9f01-13f28e72aeae None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:48.543049 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a99865-32a9-49cd-8180-363f37bf5d09 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:48.543340 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a99865-32a9-49cd-8180-363f37bf5d09 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:48.543656 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a99865-32a9-49cd-8180-363f37bf5d09 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:48.545343 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 28/53] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:48.552515 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea0dda-9590-45c2-8677-225d83fe9db1 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:48.553019 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea0dda-9590-45c2-8677-225d83fe9db1 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:48.553508 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea0dda-9590-45c2-8677-225d83fe9db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:48.582819 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-18ea0dda-9590-45c2-8677-225d83fe9db1 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:48.585014 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-18ea0dda-9590-45c2-8677-225d83fe9db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:48.622940 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:48.665804 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a9eb6-eb57-4729-9f01-13f28e72aeae None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:48.667683 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 29/54] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:27:48.726375 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc4491-4821-411e-af43-cffe5d6ce518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:48.727331 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc4491-4821-411e-af43-cffe5d6ce518 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:48.727929 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc4491-4821-411e-af43-cffe5d6ce518 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:48.728372 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc4491-4821-411e-af43-cffe5d6ce518 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:48.729699 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc4491-4821-411e-af43-cffe5d6ce518 None admin] RBAC: Adding query filter params (role.id=1e3ce9c8b9934a7bb515b39e21fc1d68, scope.domain.id=default, user.id=146ec9a584bf4142acfd366d51db1f8d) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:48.730195 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc4491-4821-411e-af43-cffe5d6ce518 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:48.732917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc4491-4821-411e-af43-cffe5d6ce518 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:48.748280 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 26/55] 10.222.0.15 () {56 vars in 1322 bytes} [Mon Aug 22 20:27:48 2022] GET /identity/v3/role_assignments?user.id=146ec9a584bf4142acfd366d51db1f8d&scope.domain.id=default&role.id=1e3ce9c8b9934a7bb515b39e21fc1d68 => generated 530 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:48.997656 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea0dda-9590-45c2-8677-225d83fe9db1 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:49.109327 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea0dda-9590-45c2-8677-225d83fe9db1 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:49.147118 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591f874-5f98-4258-be05-7cbd4619edec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:49.147781 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591f874-5f98-4258-be05-7cbd4619edec None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:49.148069 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591f874-5f98-4258-be05-7cbd4619edec None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:49.148351 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591f874-5f98-4258-be05-7cbd4619edec None admin] PATH_INFO: `/v3/domains/default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:49.149486 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591f874-5f98-4258-be05-7cbd4619edec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:49.151193 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591f874-5f98-4258-be05-7cbd4619edec None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:49.152833 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 30/56] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:49.159581 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc4491-4821-411e-af43-cffe5d6ce518 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:49.230882 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:49.291844 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc4491-4821-411e-af43-cffe5d6ce518 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:49.326554 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013cb66-beef-460f-91c1-664556770c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:49.327752 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013cb66-beef-460f-91c1-664556770c4d None admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:49.328041 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013cb66-beef-460f-91c1-664556770c4d None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:49.328319 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013cb66-beef-460f-91c1-664556770c4d None admin] PATH_INFO: `/v3/projects` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:49.328970 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013cb66-beef-460f-91c1-664556770c4d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:49.330489 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013cb66-beef-460f-91c1-664556770c4d None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:49.447672 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 27/57] 10.222.0.15 () {60 vars in 1140 bytes} [Mon Aug 22 20:27:49 2022] POST /identity/v3/projects => generated 298 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:27:51.773489 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0005bbe-f2dd-458e-a1ad-ddb41f7cb039 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:51.774041 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0005bbe-f2dd-458e-a1ad-ddb41f7cb039 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:51.774186 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0005bbe-f2dd-458e-a1ad-ddb41f7cb039 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:51.775650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 31/58] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:51.785224 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50495452-654b-435c-96ea-5fd82748452a None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:51.785759 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50495452-654b-435c-96ea-5fd82748452a None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:51.786122 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50495452-654b-435c-96ea-5fd82748452a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:51.816769 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-50495452-654b-435c-96ea-5fd82748452a None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:51.818817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-50495452-654b-435c-96ea-5fd82748452a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:51.934296 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 28/59] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:27:52.548567 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0005bbe-f2dd-458e-a1ad-ddb41f7cb039 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:52.582701 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:52.659465 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0005bbe-f2dd-458e-a1ad-ddb41f7cb039 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:52.696519 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3afff-4993-4ec2-ae4c-f305f90558db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:52.697094 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3afff-4993-4ec2-ae4c-f305f90558db None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:52.697379 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3afff-4993-4ec2-ae4c-f305f90558db None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:52.697657 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3afff-4993-4ec2-ae4c-f305f90558db None admin] PATH_INFO: `/v3/domains/default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:52.698792 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3afff-4993-4ec2-ae4c-f305f90558db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:52.700295 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3afff-4993-4ec2-ae4c-f305f90558db None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:52.701872 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 32/60] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:52.707977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50495452-654b-435c-96ea-5fd82748452a None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:52.733657 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:52.811095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50495452-654b-435c-96ea-5fd82748452a None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:52.846971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee5fd0-92f0-4c8e-90e3-23a04d1f2478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:52.847650 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee5fd0-92f0-4c8e-90e3-23a04d1f2478 None admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:52.847933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee5fd0-92f0-4c8e-90e3-23a04d1f2478 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:52.848209 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee5fd0-92f0-4c8e-90e3-23a04d1f2478 None admin] PATH_INFO: `/v3/users` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:52.848864 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee5fd0-92f0-4c8e-90e3-23a04d1f2478 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:52.850343 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee5fd0-92f0-4c8e-90e3-23a04d1f2478 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:52.981208 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 29/61] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 20:27:52 2022] POST /identity/v3/users => generated 275 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:27:56.556746 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1def51-5a5e-4e6f-91bf-7918467ef126 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:56.557888 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1def51-5a5e-4e6f-91bf-7918467ef126 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:56.558376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1def51-5a5e-4e6f-91bf-7918467ef126 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:56.560011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 33/62] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:27:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:56.566822 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97893db3-c5c4-4229-a274-2cb1981e65cd None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:56.567829 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97893db3-c5c4-4229-a274-2cb1981e65cd None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:56.568325 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97893db3-c5c4-4229-a274-2cb1981e65cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:56.593195 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-97893db3-c5c4-4229-a274-2cb1981e65cd None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:56.594784 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-97893db3-c5c4-4229-a274-2cb1981e65cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:56.697187 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 30/63] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:27:56.787715 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551450d0-ac0b-4e0c-bf77-ba7309f4c10d None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:56.788139 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551450d0-ac0b-4e0c-bf77-ba7309f4c10d None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:56.788292 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551450d0-ac0b-4e0c-bf77-ba7309f4c10d None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:56.789973 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 34/64] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:56.797255 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c74d7-bab1-47dc-afdb-cbde3d25b70b None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:56.797591 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c74d7-bab1-47dc-afdb-cbde3d25b70b None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:56.797830 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c74d7-bab1-47dc-afdb-cbde3d25b70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:56.824719 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-b18c74d7-bab1-47dc-afdb-cbde3d25b70b None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:56.825963 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-b18c74d7-bab1-47dc-afdb-cbde3d25b70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:56.829393 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:56.910934 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 31/65] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:27:56.966559 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f7683-9180-46be-9559-dbbb56f0650d None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:56.966909 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f7683-9180-46be-9559-dbbb56f0650d None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:56.967126 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f7683-9180-46be-9559-dbbb56f0650d None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:56.969361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 35/66] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:27:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:56.974858 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8347af-32f5-487d-a1ee-470cbba799cb None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:56.975158 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8347af-32f5-487d-a1ee-470cbba799cb None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:56.975449 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8347af-32f5-487d-a1ee-470cbba799cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:57.000242 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-4d8347af-32f5-487d-a1ee-470cbba799cb None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:57.001495 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-4d8347af-32f5-487d-a1ee-470cbba799cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:57.110743 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f7683-9180-46be-9559-dbbb56f0650d None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:57.111877 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 32/67] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:27:57.266656 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:57.274144 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f7683-9180-46be-9559-dbbb56f0650d None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:57.274350 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8347af-32f5-487d-a1ee-470cbba799cb None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:57.361975 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c7a40-7f3b-4cf1-a60d-fcd2319752b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:57.362775 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c7a40-7f3b-4cf1-a60d-fcd2319752b0 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:57.363233 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c7a40-7f3b-4cf1-a60d-fcd2319752b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:57.363717 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c7a40-7f3b-4cf1-a60d-fcd2319752b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:57.397922 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c7a40-7f3b-4cf1-a60d-fcd2319752b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:27:57.409387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-de1c7a40-7f3b-4cf1-a60d-fcd2319752b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:27:57.409387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:57.409387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:57.409387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:57.409387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:57.409387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:57.409387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:57.409387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:57.409387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:57.409387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:57.409387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:57.409387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:57.409387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:27:57.409387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:27:57.409387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:27:57.409387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:27:57.416805 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:27:57.416805 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:27:57.416805 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:27:57.416805 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:27:57.416805 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:57.416805 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:57.416805 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:57.416805 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:57.416805 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:57.416805 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:57.416805 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:57.416805 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:57.416805 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:57.416805 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:57.416805 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:57.416805 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:57.417662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:57.417662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:57.417662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:57.417662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:57.417662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:27:57.417662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:27:57.417662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:27:57.417662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:27:57.417662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:27:57.417662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:27:57.417662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:27:57.417662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:27:57.417662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 36/68] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:27:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:57.430708 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c7a40-7f3b-4cf1-a60d-fcd2319752b0 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:57.491706 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:57.566257 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8347af-32f5-487d-a1ee-470cbba799cb None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:57.626733 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6927fc4-4747-417e-95db-ea00847fa43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:57.627515 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6927fc4-4747-417e-95db-ea00847fa43e None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:57.627766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6927fc4-4747-417e-95db-ea00847fa43e None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:57.628154 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6927fc4-4747-417e-95db-ea00847fa43e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:57.629568 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c7a40-7f3b-4cf1-a60d-fcd2319752b0 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:57.642326 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6927fc4-4747-417e-95db-ea00847fa43e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:27:57.647889 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-b6927fc4-4747-417e-95db-ea00847fa43e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:27:57.647889 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:57.647889 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:57.647889 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:57.647889 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:57.647889 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:57.647889 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:57.647889 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:57.647889 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:57.647889 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:57.647889 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:57.647889 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:57.647889 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:27:57.647889 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:27:57.647889 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:27:57.647889 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:27:57.649011 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:27:57.649011 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:27:57.649011 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:27:57.649011 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:27:57.649011 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:57.649011 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:57.649011 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:57.649011 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:57.649011 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:57.649011 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:57.649011 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:57.649011 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:57.649011 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:57.649011 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:57.649011 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:57.649011 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:57.650120 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:57.650120 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:57.650120 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:57.650120 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:57.650120 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:27:57.650120 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:27:57.650120 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:27:57.650120 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:27:57.650120 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:27:57.650120 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:27:57.650120 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:27:57.650120 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:27:57.650120 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 33/69] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 20:27:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:57.650120 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6927fc4-4747-417e-95db-ea00847fa43e None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:57.679272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32330b-04ab-4dd5-978a-79d948fa80df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:57.679922 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32330b-04ab-4dd5-978a-79d948fa80df None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:57.680207 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32330b-04ab-4dd5-978a-79d948fa80df None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:57.680482 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32330b-04ab-4dd5-978a-79d948fa80df None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:57.681165 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32330b-04ab-4dd5-978a-79d948fa80df None admin] RBAC: Adding query filter params (name=member) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:57.681759 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32330b-04ab-4dd5-978a-79d948fa80df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:57.683183 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32330b-04ab-4dd5-978a-79d948fa80df None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:57.693409 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 37/70] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:27:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:57.694659 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7dc41-0ca2-4433-80f0-d3b6dd6654e5 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:57.695007 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7dc41-0ca2-4433-80f0-d3b6dd6654e5 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:57.695300 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7dc41-0ca2-4433-80f0-d3b6dd6654e5 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:57.696884 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 38/71] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:57.697504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7dc41-0ca2-4433-80f0-d3b6dd6654e5 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:57.728338 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:57.784047 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6927fc4-4747-417e-95db-ea00847fa43e None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:57.815508 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7dc41-0ca2-4433-80f0-d3b6dd6654e5 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:57.816146 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:57.822180 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea3602-96f1-4cfe-8095-0b30df3b8815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:57.822827 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea3602-96f1-4cfe-8095-0b30df3b8815 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:57.828532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea3602-96f1-4cfe-8095-0b30df3b8815 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:57.828532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea3602-96f1-4cfe-8095-0b30df3b8815 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:57.838232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea3602-96f1-4cfe-8095-0b30df3b8815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:27:57.848762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-30ea3602-96f1-4cfe-8095-0b30df3b8815 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:27:57.848762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:57.848762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:57.848762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:57.848762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:57.848762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:57.848762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:57.848762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:57.848762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:57.848762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:57.848762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:57.848762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:57.848762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:27:57.848762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:27:57.848762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:27:57.848762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:27:57.850171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:27:57.850171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:27:57.850171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:27:57.850171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:27:57.850171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:57.850171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:57.850171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:57.850171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:57.850171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:57.850171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:57.850171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:57.850171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:57.850171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:57.850171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:57.850171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:57.850171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:57.851423 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:57.851423 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:57.851423 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:57.851423 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:57.851423 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:27:57.851423 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:27:57.851423 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:27:57.851423 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:27:57.851423 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:27:57.851423 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:27:57.851423 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:27:57.851423 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:27:57.851423 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 34/72] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 20:27:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:57.851423 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3af06-4d1c-4fb8-a77f-daf4ac0e7c81 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:57.852204 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3af06-4d1c-4fb8-a77f-daf4ac0e7c81 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:57.852204 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3af06-4d1c-4fb8-a77f-daf4ac0e7c81 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:57.853165 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 35/73] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:57.859667 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3af06-4d1c-4fb8-a77f-daf4ac0e7c81 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:57.859924 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7503175-9f58-449a-924d-60ebc555d0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:57.860555 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7503175-9f58-449a-924d-60ebc555d0ff None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:57.860832 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7503175-9f58-449a-924d-60ebc555d0ff None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:57.861122 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7503175-9f58-449a-924d-60ebc555d0ff None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:57.861804 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7503175-9f58-449a-924d-60ebc555d0ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:57.862198 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7503175-9f58-449a-924d-60ebc555d0ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:57.863607 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7503175-9f58-449a-924d-60ebc555d0ff None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:57.872710 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 39/74] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:27:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:57.873890 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a28c98-7fef-454f-aed2-e91d733b652d None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:57.874230 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a28c98-7fef-454f-aed2-e91d733b652d None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:57.874511 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a28c98-7fef-454f-aed2-e91d733b652d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:57.894783 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-05a28c98-7fef-454f-aed2-e91d733b652d None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:57.896116 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-05a28c98-7fef-454f-aed2-e91d733b652d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:57.972664 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 40/75] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:27:57.973544 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a28c98-7fef-454f-aed2-e91d733b652d None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:57.988187 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3af06-4d1c-4fb8-a77f-daf4ac0e7c81 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:58.005645 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:58.040044 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd9413-d308-4069-b7f8-cf0b2b91d966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:58.040941 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd9413-d308-4069-b7f8-cf0b2b91d966 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:58.041393 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd9413-d308-4069-b7f8-cf0b2b91d966 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:58.041692 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd9413-d308-4069-b7f8-cf0b2b91d966 None admin] PATH_INFO: `/v3/users/2bcfb45b3fc3478a81cf1941e9ba32a7` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:58.063140 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd9413-d308-4069-b7f8-cf0b2b91d966 None admin] RBAC: Authorizing `identity:get_user(user_id=2bcfb45b3fc3478a81cf1941e9ba32a7)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:58.066268 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd9413-d308-4069-b7f8-cf0b2b91d966 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:58.074306 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 36/76] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:27:57 2022] GET /identity/v3/users/2bcfb45b3fc3478a81cf1941e9ba32a7 => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:58.074306 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1f66c-7ba3-435f-a82a-0a8d5dc2e555 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:58.074306 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1f66c-7ba3-435f-a82a-0a8d5dc2e555 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:58.074306 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1f66c-7ba3-435f-a82a-0a8d5dc2e555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:58.104824 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-23e1f66c-7ba3-435f-a82a-0a8d5dc2e555 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:58.107056 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-23e1f66c-7ba3-435f-a82a-0a8d5dc2e555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:58.158210 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a28c98-7fef-454f-aed2-e91d733b652d None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:58.184906 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:58.220736 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 37/77] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:27:58.222907 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1f66c-7ba3-435f-a82a-0a8d5dc2e555 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:58.237958 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718be2a-b4a1-498c-9fa3-d9969fb98fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:58.239392 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718be2a-b4a1-498c-9fa3-d9969fb98fec None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:58.240217 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718be2a-b4a1-498c-9fa3-d9969fb98fec None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:58.240933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718be2a-b4a1-498c-9fa3-d9969fb98fec None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:58.243447 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718be2a-b4a1-498c-9fa3-d9969fb98fec None admin] RBAC: Adding query filter params (name=admin) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:58.244336 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718be2a-b4a1-498c-9fa3-d9969fb98fec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:58.248034 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718be2a-b4a1-498c-9fa3-d9969fb98fec None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:58.273636 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 41/78] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:27:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:58.273636 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718be2a-b4a1-498c-9fa3-d9969fb98fec None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:58.403793 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:58.428519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1f66c-7ba3-435f-a82a-0a8d5dc2e555 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:58.446769 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718be2a-b4a1-498c-9fa3-d9969fb98fec None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:58.490883 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b648bb-6390-495b-baab-6f21fe143c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:58.491493 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7c25d-bd05-481e-9e82-6e64d0b2c62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:58.497887 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b648bb-6390-495b-baab-6f21fe143c88 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:58.497887 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b648bb-6390-495b-baab-6f21fe143c88 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:58.497887 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b648bb-6390-495b-baab-6f21fe143c88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:58.498262 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7c25d-bd05-481e-9e82-6e64d0b2c62d None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:58.498262 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7c25d-bd05-481e-9e82-6e64d0b2c62d None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:58.498262 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7c25d-bd05-481e-9e82-6e64d0b2c62d None admin] PATH_INFO: `/v3/users/2bcfb45b3fc3478a81cf1941e9ba32a7` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:58.498262 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7c25d-bd05-481e-9e82-6e64d0b2c62d None admin] RBAC: Authorizing `identity:get_user(user_id=2bcfb45b3fc3478a81cf1941e9ba32a7)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:58.498794 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7c25d-bd05-481e-9e82-6e64d0b2c62d None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:58.507580 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 38/79] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:27:58 2022] GET /identity/v3/users/2bcfb45b3fc3478a81cf1941e9ba32a7 => generated 275 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:58.507580 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7c25d-bd05-481e-9e82-6e64d0b2c62d None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:58.571667 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:58.604264 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b648bb-6390-495b-baab-6f21fe143c88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:58.606526 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b648bb-6390-495b-baab-6f21fe143c88 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:58.653411 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7c25d-bd05-481e-9e82-6e64d0b2c62d None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:58.695669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:58.708545 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60368ea3-3b8d-4560-a37f-b23a0d8335c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:58.709199 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60368ea3-3b8d-4560-a37f-b23a0d8335c2 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:58.709488 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60368ea3-3b8d-4560-a37f-b23a0d8335c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:58.709763 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60368ea3-3b8d-4560-a37f-b23a0d8335c2 None admin] PATH_INFO: `/v3/users/146ec9a584bf4142acfd366d51db1f8d` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:58.711043 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60368ea3-3b8d-4560-a37f-b23a0d8335c2 None admin] RBAC: Authorizing `identity:get_user(user_id=146ec9a584bf4142acfd366d51db1f8d)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:58.712578 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60368ea3-3b8d-4560-a37f-b23a0d8335c2 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:58.714273 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 39/80] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:27:58 2022] GET /identity/v3/users/146ec9a584bf4142acfd366d51db1f8d => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:58.716721 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60368ea3-3b8d-4560-a37f-b23a0d8335c2 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:58.739766 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 42/81] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:27:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:27:58.747524 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b648bb-6390-495b-baab-6f21fe143c88 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:58.851753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60368ea3-3b8d-4560-a37f-b23a0d8335c2 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:58.869068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:58.877756 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b648bb-6390-495b-baab-6f21fe143c88 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:58.897877 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca0766-f01b-41ab-9f3e-56dd7e43deb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:58.898957 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca0766-f01b-41ab-9f3e-56dd7e43deb2 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:58.899601 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca0766-f01b-41ab-9f3e-56dd7e43deb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:58.900105 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca0766-f01b-41ab-9f3e-56dd7e43deb2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:58.902290 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca0766-f01b-41ab-9f3e-56dd7e43deb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:58.904958 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca0766-f01b-41ab-9f3e-56dd7e43deb2 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:58.908357 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 40/82] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:58.909407 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca0766-f01b-41ab-9f3e-56dd7e43deb2 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:58.919914 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9e1f5-0748-41fa-b302-c4f35d83eabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:58.920636 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9e1f5-0748-41fa-b302-c4f35d83eabf None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:58.921601 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9e1f5-0748-41fa-b302-c4f35d83eabf None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:58.921980 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9e1f5-0748-41fa-b302-c4f35d83eabf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:58.975644 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:59.006131 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9e1f5-0748-41fa-b302-c4f35d83eabf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:59.007878 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9e1f5-0748-41fa-b302-c4f35d83eabf None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:59.025281 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca0766-f01b-41ab-9f3e-56dd7e43deb2 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:59.069668 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fbf42-3fa2-4904-8d95-56e23bbf8f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:59.070729 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fbf42-3fa2-4904-8d95-56e23bbf8f70 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:59.071224 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fbf42-3fa2-4904-8d95-56e23bbf8f70 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:59.071768 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fbf42-3fa2-4904-8d95-56e23bbf8f70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:59.090809 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fbf42-3fa2-4904-8d95-56e23bbf8f70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:27:59.100346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-3a5fbf42-3fa2-4904-8d95-56e23bbf8f70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:27:59.100346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:59.100346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:59.100346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:59.100346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:59.100346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:59.100346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:59.100346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:59.100346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:59.100346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:59.100346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:59.100346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:59.100346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:27:59.100346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:27:59.100346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:27:59.100346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:27:59.101433 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:27:59.101433 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:27:59.101433 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:27:59.101433 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:27:59.101433 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:59.101433 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:59.101433 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:59.101433 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:59.101433 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:59.101433 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:59.101433 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:59.101433 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:59.101433 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:59.101433 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:59.101433 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:59.101433 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:59.102333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:59.102333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:59.102333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:59.102333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:59.102333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:27:59.102333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:27:59.102333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:27:59.102333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:27:59.102333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:27:59.102333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:27:59.102333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:27:59.102333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:27:59.103056 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 41/83] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:27:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:59.104090 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fbf42-3fa2-4904-8d95-56e23bbf8f70 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:59.127640 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 43/84] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:27:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:27:59.129313 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9e1f5-0748-41fa-b302-c4f35d83eabf None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:59.180582 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:59.219730 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:59.243746 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fbf42-3fa2-4904-8d95-56e23bbf8f70 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:59.263177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9e1f5-0748-41fa-b302-c4f35d83eabf None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:59.280969 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4bf32-240a-4329-aa3f-caffc29c708e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:59.281586 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4bf32-240a-4329-aa3f-caffc29c708e None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:59.281865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4bf32-240a-4329-aa3f-caffc29c708e None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:59.282139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4bf32-240a-4329-aa3f-caffc29c708e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:59.320825 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d1b1d-16bb-4359-9d6b-202faa7afd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:59.321482 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d1b1d-16bb-4359-9d6b-202faa7afd21 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:59.321761 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d1b1d-16bb-4359-9d6b-202faa7afd21 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:59.324776 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d1b1d-16bb-4359-9d6b-202faa7afd21 None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:59.324776 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d1b1d-16bb-4359-9d6b-202faa7afd21 None admin] RBAC: Authorizing `identity:get_project(project_id=7bb022d88d4f49bc889242cf22018981)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:59.324776 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d1b1d-16bb-4359-9d6b-202faa7afd21 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:59.326959 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 44/85] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:27:59 2022] GET /identity/v3/projects/7bb022d88d4f49bc889242cf22018981 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:59.329052 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d1b1d-16bb-4359-9d6b-202faa7afd21 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:59.370332 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4bf32-240a-4329-aa3f-caffc29c708e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:59.372402 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4bf32-240a-4329-aa3f-caffc29c708e None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:59.423573 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:59.480593 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d1b1d-16bb-4359-9d6b-202faa7afd21 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:59.516086 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 42/86] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:27:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:27:59.516887 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4bf32-240a-4329-aa3f-caffc29c708e None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:59.528981 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e5db7-4706-4312-8751-66d24055733f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:59.529855 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e5db7-4706-4312-8751-66d24055733f None admin] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:59.530388 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e5db7-4706-4312-8751-66d24055733f None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:59.530830 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e5db7-4706-4312-8751-66d24055733f None admin] PATH_INFO: `/v3/users` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:59.531685 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e5db7-4706-4312-8751-66d24055733f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:59.533512 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e5db7-4706-4312-8751-66d24055733f None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:59.632474 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4bf32-240a-4329-aa3f-caffc29c708e None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:59.671153 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbd9a8-2c32-4adb-8a81-6336cd23557b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:59.671945 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbd9a8-2c32-4adb-8a81-6336cd23557b None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:59.672070 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbd9a8-2c32-4adb-8a81-6336cd23557b None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:59.672343 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbd9a8-2c32-4adb-8a81-6336cd23557b None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:59.673076 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbd9a8-2c32-4adb-8a81-6336cd23557b None admin] RBAC: Adding query filter params (name=member) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:59.673368 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbd9a8-2c32-4adb-8a81-6336cd23557b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:59.674826 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbd9a8-2c32-4adb-8a81-6336cd23557b None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:59.688906 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 43/87] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:27:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:59.691820 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbd9a8-2c32-4adb-8a81-6336cd23557b None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:59.698140 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:59.705669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:59.712297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 45/88] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 20:27:59 2022] POST /identity/v3/users => generated 289 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:27:59.713809 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e5db7-4706-4312-8751-66d24055733f None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:59.867153 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbd9a8-2c32-4adb-8a81-6336cd23557b None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:59.884559 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e5db7-4706-4312-8751-66d24055733f None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:59.931079 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f806d8-0860-4c0a-b687-40f0f06cd3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:59.932519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f806d8-0860-4c0a-b687-40f0f06cd3ed None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:59.932897 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f806d8-0860-4c0a-b687-40f0f06cd3ed None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:59.933200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f806d8-0860-4c0a-b687-40f0f06cd3ed None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:59.934967 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f806d8-0860-4c0a-b687-40f0f06cd3ed None admin] RBAC: Authorizing `identity:get_project(project_id=7bb022d88d4f49bc889242cf22018981)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:59.938024 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f806d8-0860-4c0a-b687-40f0f06cd3ed None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:59.943521 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 44/89] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:27:59 2022] GET /identity/v3/projects/7bb022d88d4f49bc889242cf22018981 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:59.943521 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f806d8-0860-4c0a-b687-40f0f06cd3ed None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:59.950537 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe5549-e872-4d5c-818c-be8f73acf136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:59.951273 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe5549-e872-4d5c-818c-be8f73acf136 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:59.951686 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe5549-e872-4d5c-818c-be8f73acf136 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:59.951965 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe5549-e872-4d5c-818c-be8f73acf136 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:59.952869 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe5549-e872-4d5c-818c-be8f73acf136 None admin] RBAC: Adding query filter params (role.id=910e8004690649e3b4fc1c4be76ad967, scope.project.id=7bb022d88d4f49bc889242cf22018981, user.id=2bcfb45b3fc3478a81cf1941e9ba32a7) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:59.953209 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe5549-e872-4d5c-818c-be8f73acf136 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:59.954797 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe5549-e872-4d5c-818c-be8f73acf136 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:59.962885 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 46/90] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:27:59 2022] GET /identity/v3/role_assignments?user.id=2bcfb45b3fc3478a81cf1941e9ba32a7&scope.project.id=7bb022d88d4f49bc889242cf22018981&role.id=910e8004690649e3b4fc1c4be76ad967 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:59.977649 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe5549-e872-4d5c-818c-be8f73acf136 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:00.083223 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:00.084546 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:00.147500 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f806d8-0860-4c0a-b687-40f0f06cd3ed None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:00.173255 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe5549-e872-4d5c-818c-be8f73acf136 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:00.205934 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0109ee-47d9-47a7-8597-5a7322536cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:00.206645 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0109ee-47d9-47a7-8597-5a7322536cb7 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:00.206935 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0109ee-47d9-47a7-8597-5a7322536cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:00.207213 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0109ee-47d9-47a7-8597-5a7322536cb7 None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:00.209204 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0109ee-47d9-47a7-8597-5a7322536cb7 None admin] RBAC: Authorizing `identity:get_project(project_id=7bb022d88d4f49bc889242cf22018981)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:00.210244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0109ee-47d9-47a7-8597-5a7322536cb7 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:00.223205 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 45/91] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:27:59 2022] GET /identity/v3/projects/7bb022d88d4f49bc889242cf22018981 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:00.223205 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0109ee-47d9-47a7-8597-5a7322536cb7 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:00.253982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f62599-c6c3-4d61-8081-e78d0989052b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:00.255020 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f62599-c6c3-4d61-8081-e78d0989052b None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:00.255480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f62599-c6c3-4d61-8081-e78d0989052b None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:00.256005 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f62599-c6c3-4d61-8081-e78d0989052b None admin] PATH_INFO: `/v3/users/2bcfb45b3fc3478a81cf1941e9ba32a7` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:00.265453 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f62599-c6c3-4d61-8081-e78d0989052b None admin] RBAC: Authorizing `identity:get_user(user_id=2bcfb45b3fc3478a81cf1941e9ba32a7)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:00.268044 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f62599-c6c3-4d61-8081-e78d0989052b None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:00.271327 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 47/92] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:27:59 2022] GET /identity/v3/users/2bcfb45b3fc3478a81cf1941e9ba32a7 => generated 275 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:00.272872 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f62599-c6c3-4d61-8081-e78d0989052b None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:00.378166 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0109ee-47d9-47a7-8597-5a7322536cb7 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:00.425232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9c515-dea4-41b0-bd00-a9f81cc27854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:00.426465 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9c515-dea4-41b0-bd00-a9f81cc27854 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:00.426970 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9c515-dea4-41b0-bd00-a9f81cc27854 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:00.427464 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9c515-dea4-41b0-bd00-a9f81cc27854 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:00.428459 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9c515-dea4-41b0-bd00-a9f81cc27854 None admin] RBAC: Adding query filter params (role.id=fcd9a48e6c4b4c048380a57be435c3dd, scope.project.id=7bb022d88d4f49bc889242cf22018981, user.id=2bcfb45b3fc3478a81cf1941e9ba32a7) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:00.429015 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9c515-dea4-41b0-bd00-a9f81cc27854 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:00.431032 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9c515-dea4-41b0-bd00-a9f81cc27854 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:00.440291 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 46/93] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:28:00 2022] GET /identity/v3/role_assignments?user.id=2bcfb45b3fc3478a81cf1941e9ba32a7&scope.project.id=7bb022d88d4f49bc889242cf22018981&role.id=fcd9a48e6c4b4c048380a57be435c3dd => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:00.442620 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9c515-dea4-41b0-bd00-a9f81cc27854 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:00.447050 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:00.508626 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f62599-c6c3-4d61-8081-e78d0989052b None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:00.553877 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:00.562226 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b884281-d8fe-4388-bc15-fa31df2c1934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:00.563408 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b884281-d8fe-4388-bc15-fa31df2c1934 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:00.563930 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b884281-d8fe-4388-bc15-fa31df2c1934 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:00.564375 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b884281-d8fe-4388-bc15-fa31df2c1934 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:00.565370 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b884281-d8fe-4388-bc15-fa31df2c1934 None admin] RBAC: Adding query filter params (role.id=1e3ce9c8b9934a7bb515b39e21fc1d68, scope.project.id=7bb022d88d4f49bc889242cf22018981, user.id=146ec9a584bf4142acfd366d51db1f8d) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:00.572273 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b884281-d8fe-4388-bc15-fa31df2c1934 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:00.572273 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b884281-d8fe-4388-bc15-fa31df2c1934 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:00.576205 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 48/94] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:28:00 2022] GET /identity/v3/role_assignments?user.id=146ec9a584bf4142acfd366d51db1f8d&scope.project.id=7bb022d88d4f49bc889242cf22018981&role.id=1e3ce9c8b9934a7bb515b39e21fc1d68 => generated 259 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:00.670377 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9c515-dea4-41b0-bd00-a9f81cc27854 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:00.729341 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62da12-2175-4ae6-9714-cced542f4032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:00.730277 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62da12-2175-4ae6-9714-cced542f4032 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:00.730277 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62da12-2175-4ae6-9714-cced542f4032 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:00.730534 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62da12-2175-4ae6-9714-cced542f4032 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:00.827618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62da12-2175-4ae6-9714-cced542f4032 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:00.829202 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62da12-2175-4ae6-9714-cced542f4032 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:00.832860 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:01.096370 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 47/95] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:28:01.106101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b884281-d8fe-4388-bc15-fa31df2c1934 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:01.314698 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b884281-d8fe-4388-bc15-fa31df2c1934 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:01.393628 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7c176-cb96-4fd4-8663-38c6dda1c1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:01.394641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7c176-cb96-4fd4-8663-38c6dda1c1b7 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:01.395122 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7c176-cb96-4fd4-8663-38c6dda1c1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:01.395625 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7c176-cb96-4fd4-8663-38c6dda1c1b7 None admin] PATH_INFO: `/v3/projects/cbee6caf478641419e1fe9e594bbfec6` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:01.400888 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7c176-cb96-4fd4-8663-38c6dda1c1b7 None admin] RBAC: Authorizing `identity:get_project(project_id=cbee6caf478641419e1fe9e594bbfec6)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:01.403697 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7c176-cb96-4fd4-8663-38c6dda1c1b7 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:01.407718 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 49/96] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:01 2022] GET /identity/v3/projects/cbee6caf478641419e1fe9e594bbfec6 => generated 312 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:01.417024 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62da12-2175-4ae6-9714-cced542f4032 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:01.591240 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62da12-2175-4ae6-9714-cced542f4032 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:01.601326 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:01.642679 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92ac77-a60f-4f42-9458-ea1967118aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:01.643309 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92ac77-a60f-4f42-9458-ea1967118aee None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:01.643613 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92ac77-a60f-4f42-9458-ea1967118aee None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:01.643949 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92ac77-a60f-4f42-9458-ea1967118aee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:01.644627 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92ac77-a60f-4f42-9458-ea1967118aee None admin] RBAC: Adding query filter params (role.id=910e8004690649e3b4fc1c4be76ad967, scope.project.id=cbee6caf478641419e1fe9e594bbfec6, user.id=2bcfb45b3fc3478a81cf1941e9ba32a7) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:01.644943 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92ac77-a60f-4f42-9458-ea1967118aee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:01.646433 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92ac77-a60f-4f42-9458-ea1967118aee None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:01.657346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 48/97] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:28:01 2022] GET /identity/v3/role_assignments?user.id=2bcfb45b3fc3478a81cf1941e9ba32a7&scope.project.id=cbee6caf478641419e1fe9e594bbfec6&role.id=910e8004690649e3b4fc1c4be76ad967 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:03.624235 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc794d-1eab-4b07-8878-48b05b7fcb24 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:03.624812 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc794d-1eab-4b07-8878-48b05b7fcb24 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:03.624812 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc794d-1eab-4b07-8878-48b05b7fcb24 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:03.626146 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 50/98] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:03.637806 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889494a3-23bc-467e-a8be-62ac47e22dc0 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:03.638443 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889494a3-23bc-467e-a8be-62ac47e22dc0 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:03.638443 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889494a3-23bc-467e-a8be-62ac47e22dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:03.670577 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-889494a3-23bc-467e-a8be-62ac47e22dc0 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:03.672392 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-889494a3-23bc-467e-a8be-62ac47e22dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:03.778980 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 49/99] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:28:03.926835 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ec88c-9a2a-4199-8415-9fd40b7c0eee None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:03.927162 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ec88c-9a2a-4199-8415-9fd40b7c0eee None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:03.927352 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ec88c-9a2a-4199-8415-9fd40b7c0eee None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:03.928810 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 51/100] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:03.945064 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc48aa3-031c-46c0-8265-14e26211c7c9 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:03.945355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc48aa3-031c-46c0-8265-14e26211c7c9 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:03.945634 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc48aa3-031c-46c0-8265-14e26211c7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:03.968796 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-dbc48aa3-031c-46c0-8265-14e26211c7c9 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:03.970015 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-dbc48aa3-031c-46c0-8265-14e26211c7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:04.149561 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 50/101] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:04.349905 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352b0c9-d889-4d4a-90d9-a32a43a13ef9 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:04.350280 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352b0c9-d889-4d4a-90d9-a32a43a13ef9 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:04.350458 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352b0c9-d889-4d4a-90d9-a32a43a13ef9 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:04.352080 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 52/102] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:04.360593 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22ace8-c522-4021-a45f-6e72248314de None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:04.360889 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22ace8-c522-4021-a45f-6e72248314de None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:04.361151 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22ace8-c522-4021-a45f-6e72248314de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:04.396762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-7a22ace8-c522-4021-a45f-6e72248314de None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:04.397996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-7a22ace8-c522-4021-a45f-6e72248314de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:04.436657 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:04.490956 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 51/103] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:28:04.531104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55040523-a603-48e5-ae1f-ceebfb9f7356 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:04.531405 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55040523-a603-48e5-ae1f-ceebfb9f7356 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:04.531715 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55040523-a603-48e5-ae1f-ceebfb9f7356 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:04.533185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 53/104] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:04.539579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5dbe0-97f8-4fdd-b954-6e94f326cc40 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:04.539579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5dbe0-97f8-4fdd-b954-6e94f326cc40 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:04.539788 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5dbe0-97f8-4fdd-b954-6e94f326cc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:04.551230 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55040523-a603-48e5-ae1f-ceebfb9f7356 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:04.576295 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-b3d5dbe0-97f8-4fdd-b954-6e94f326cc40 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:04.579182 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-b3d5dbe0-97f8-4fdd-b954-6e94f326cc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:04.713844 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 52/105] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:28:04.744204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:04.775225 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55040523-a603-48e5-ae1f-ceebfb9f7356 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:04.824335 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac681e6-b59f-4e1f-b521-a8368560a7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:04.824987 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac681e6-b59f-4e1f-b521-a8368560a7eb None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:04.825270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac681e6-b59f-4e1f-b521-a8368560a7eb None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:04.825544 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac681e6-b59f-4e1f-b521-a8368560a7eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:04.826749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac681e6-b59f-4e1f-b521-a8368560a7eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:04.829003 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac681e6-b59f-4e1f-b521-a8368560a7eb None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:04.830816 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 54/106] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:28:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:04.837196 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5dbe0-97f8-4fdd-b954-6e94f326cc40 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:04.916056 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac681e6-b59f-4e1f-b521-a8368560a7eb None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:04.965880 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:04.990094 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5dbe0-97f8-4fdd-b954-6e94f326cc40 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:05.064505 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211c3b1-fbf9-4df6-98df-e3bbb52bbcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:05.065132 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211c3b1-fbf9-4df6-98df-e3bbb52bbcca None admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:05.065413 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211c3b1-fbf9-4df6-98df-e3bbb52bbcca None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:05.065683 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211c3b1-fbf9-4df6-98df-e3bbb52bbcca None admin] PATH_INFO: `/v3/projects` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:05.066355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211c3b1-fbf9-4df6-98df-e3bbb52bbcca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:05.067879 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211c3b1-fbf9-4df6-98df-e3bbb52bbcca None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:05.122016 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac681e6-b59f-4e1f-b521-a8368560a7eb None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:05.164129 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 53/107] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 20:28:04 2022] POST /identity/v3/projects => generated 302 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:28:05.171200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211c3b1-fbf9-4df6-98df-e3bbb52bbcca None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:05.173721 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:05.183983 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12323e4-d4df-40b6-b3d0-1d8fc04f299f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:05.184679 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12323e4-d4df-40b6-b3d0-1d8fc04f299f None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:05.184958 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12323e4-d4df-40b6-b3d0-1d8fc04f299f None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:05.185235 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12323e4-d4df-40b6-b3d0-1d8fc04f299f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:05.212702 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12323e4-d4df-40b6-b3d0-1d8fc04f299f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:05.217662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-c12323e4-d4df-40b6-b3d0-1d8fc04f299f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:28:05.217662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:05.217662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:05.217662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:05.217662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:05.217662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:05.217662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:05.217662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:05.217662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:05.217662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:05.217662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:05.217662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:05.217662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:05.217662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:05.217662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:05.217662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:05.224017 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:05.224017 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:05.224017 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:05.224017 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:05.224017 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:05.224017 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:05.224017 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:05.224017 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:05.224017 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:05.224017 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:05.224017 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:05.224017 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:05.224017 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:05.224017 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:05.224017 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:05.224017 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:05.225644 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:05.225644 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:05.225644 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:05.225644 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:05.225644 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:05.225644 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:05.225644 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:05.225644 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:05.225644 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:05.225644 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:05.225644 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:28:05.225644 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:05.225644 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 55/108] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:28:05.228530 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12323e4-d4df-40b6-b3d0-1d8fc04f299f None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:05.334471 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211c3b1-fbf9-4df6-98df-e3bbb52bbcca None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:05.381792 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842d7fd-3f63-4f8d-9278-fcb5e3486164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:05.382912 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842d7fd-3f63-4f8d-9278-fcb5e3486164 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:05.383435 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842d7fd-3f63-4f8d-9278-fcb5e3486164 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:05.384013 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842d7fd-3f63-4f8d-9278-fcb5e3486164 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:05.396196 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:05.402031 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842d7fd-3f63-4f8d-9278-fcb5e3486164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:05.407698 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-9842d7fd-3f63-4f8d-9278-fcb5e3486164 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:28:05.407698 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:05.407698 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:05.407698 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:05.407698 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:05.407698 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:05.407698 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:05.407698 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:05.407698 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:05.407698 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:05.407698 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:05.407698 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:05.407698 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:05.407698 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:05.407698 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:05.407698 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:05.415444 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:05.415444 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:05.415444 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:05.415444 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:05.415444 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:05.415444 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:05.415444 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:05.415444 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:05.415444 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:05.415444 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:05.415444 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:05.415444 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:05.415444 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:05.415444 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:05.415444 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:05.415444 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:05.416369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:05.416369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:05.416369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:05.416369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:05.416369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:05.416369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:05.416369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:05.416369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:05.416369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:05.416369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:05.416369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:28:05.416369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:28:05.416369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 54/109] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 20:28:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:05.416369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842d7fd-3f63-4f8d-9278-fcb5e3486164 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:05.419325 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12323e4-d4df-40b6-b3d0-1d8fc04f299f None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:05.464527 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ad8ba-4d9f-4ea9-945a-30d8c5e16c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:05.465422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ad8ba-4d9f-4ea9-945a-30d8c5e16c4c None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:05.465879 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ad8ba-4d9f-4ea9-945a-30d8c5e16c4c None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:05.466301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ad8ba-4d9f-4ea9-945a-30d8c5e16c4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:05.481164 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ad8ba-4d9f-4ea9-945a-30d8c5e16c4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:05.487514 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-100ad8ba-4d9f-4ea9-945a-30d8c5e16c4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:05.487514 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:05.487514 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:05.487514 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:05.487514 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:05.487514 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:05.487514 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:05.487514 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:05.487514 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:05.487514 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:05.487514 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:05.487514 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:05.487514 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:05.487514 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:05.487514 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:05.487514 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:05.488611 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:05.488611 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:05.488611 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:05.488611 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:05.488611 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:05.488611 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:05.488611 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:05.488611 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:05.488611 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:05.488611 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:05.488611 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:05.488611 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:05.488611 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:05.488611 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:05.488611 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:05.488611 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:05.489585 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:05.489585 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:05.489585 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:05.489585 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:05.489585 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:05.489585 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:05.489585 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:05.489585 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:05.489585 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:05.489585 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:05.489585 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:05.489585 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:05.491643 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 56/110] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:05.493105 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138e765-7810-46c7-94ca-88e996685e55 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:05.493616 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138e765-7810-46c7-94ca-88e996685e55 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:05.494036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138e765-7810-46c7-94ca-88e996685e55 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:05.495481 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 57/111] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:05.500618 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138e765-7810-46c7-94ca-88e996685e55 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:05.555112 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842d7fd-3f63-4f8d-9278-fcb5e3486164 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:05.577737 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:05.614730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fa53d-6d84-4ac5-8108-0e3277fc3876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:05.615858 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fa53d-6d84-4ac5-8108-0e3277fc3876 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:05.616337 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fa53d-6d84-4ac5-8108-0e3277fc3876 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:05.616788 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fa53d-6d84-4ac5-8108-0e3277fc3876 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:05.617618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fa53d-6d84-4ac5-8108-0e3277fc3876 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:05.618046 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fa53d-6d84-4ac5-8108-0e3277fc3876 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:05.620540 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fa53d-6d84-4ac5-8108-0e3277fc3876 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:05.635819 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 55/112] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:05.637513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17697f23-3e18-496f-84af-b7bec32d0961 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:05.637928 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17697f23-3e18-496f-84af-b7bec32d0961 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:05.638321 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17697f23-3e18-496f-84af-b7bec32d0961 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:05.641371 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 56/113] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:05.641371 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17697f23-3e18-496f-84af-b7bec32d0961 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:05.685216 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138e765-7810-46c7-94ca-88e996685e55 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:05.733850 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efcfb9-a69a-4a44-89f0-a18bcbff5aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:05.734566 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efcfb9-a69a-4a44-89f0-a18bcbff5aaf None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:05.735568 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efcfb9-a69a-4a44-89f0-a18bcbff5aaf None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:05.735568 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efcfb9-a69a-4a44-89f0-a18bcbff5aaf None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:05.736753 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efcfb9-a69a-4a44-89f0-a18bcbff5aaf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:05.737187 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efcfb9-a69a-4a44-89f0-a18bcbff5aaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:05.739912 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efcfb9-a69a-4a44-89f0-a18bcbff5aaf None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:05.748512 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:05.757665 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 58/114] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:28:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:05.763613 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00572cc6-c10e-4221-8032-b001bb311374 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:05.763613 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00572cc6-c10e-4221-8032-b001bb311374 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:05.763613 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00572cc6-c10e-4221-8032-b001bb311374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:05.794729 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-00572cc6-c10e-4221-8032-b001bb311374 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:05.796427 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-00572cc6-c10e-4221-8032-b001bb311374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:05.812139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17697f23-3e18-496f-84af-b7bec32d0961 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:05.858873 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6126a-f482-4763-a623-d2ae3b8923e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:05.859983 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6126a-f482-4763-a623-d2ae3b8923e2 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:05.860269 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6126a-f482-4763-a623-d2ae3b8923e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:05.860585 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6126a-f482-4763-a623-d2ae3b8923e2 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:05.861482 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6126a-f482-4763-a623-d2ae3b8923e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:05.861795 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6126a-f482-4763-a623-d2ae3b8923e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:05.863217 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6126a-f482-4763-a623-d2ae3b8923e2 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:05.878421 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 57/115] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:05.878421 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32a4a2-d6c8-4729-bb96-083f1b2041ac None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:05.878421 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32a4a2-d6c8-4729-bb96-083f1b2041ac None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:05.878421 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32a4a2-d6c8-4729-bb96-083f1b2041ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:05.895289 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-8b32a4a2-d6c8-4729-bb96-083f1b2041ac None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:05.896568 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-8b32a4a2-d6c8-4729-bb96-083f1b2041ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:05.918861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 59/116] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:05.919872 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00572cc6-c10e-4221-8032-b001bb311374 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:05.978839 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:06.028457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 58/117] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:06.029776 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32a4a2-d6c8-4729-bb96-083f1b2041ac None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:06.110970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00572cc6-c10e-4221-8032-b001bb311374 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:06.137317 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:06.181893 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26e8ea-305d-45d5-a8fb-5749241ba1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:06.182791 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26e8ea-305d-45d5-a8fb-5749241ba1c7 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:06.183067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26e8ea-305d-45d5-a8fb-5749241ba1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:06.183337 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26e8ea-305d-45d5-a8fb-5749241ba1c7 None admin] PATH_INFO: `/v3/users/98a48729723448dba253a13398ea07dd` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:06.198663 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26e8ea-305d-45d5-a8fb-5749241ba1c7 None admin] RBAC: Authorizing `identity:get_user(user_id=98a48729723448dba253a13398ea07dd)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:06.200269 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26e8ea-305d-45d5-a8fb-5749241ba1c7 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:06.202081 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 60/118] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:05 2022] GET /identity/v3/users/98a48729723448dba253a13398ea07dd => generated 289 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:06.202827 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26e8ea-305d-45d5-a8fb-5749241ba1c7 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:06.223493 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32a4a2-d6c8-4729-bb96-083f1b2041ac None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:06.277202 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da16ab-107f-4dcc-a8b7-109f434f2ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:06.278254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da16ab-107f-4dcc-a8b7-109f434f2ba8 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:06.278804 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da16ab-107f-4dcc-a8b7-109f434f2ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:06.279284 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da16ab-107f-4dcc-a8b7-109f434f2ba8 None admin] PATH_INFO: `/v3/users/2bcfb45b3fc3478a81cf1941e9ba32a7` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:06.281506 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da16ab-107f-4dcc-a8b7-109f434f2ba8 None admin] RBAC: Authorizing `identity:get_user(user_id=2bcfb45b3fc3478a81cf1941e9ba32a7)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:06.283254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da16ab-107f-4dcc-a8b7-109f434f2ba8 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:06.285415 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 59/119] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:06 2022] GET /identity/v3/users/2bcfb45b3fc3478a81cf1941e9ba32a7 => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:06.293117 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da16ab-107f-4dcc-a8b7-109f434f2ba8 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:06.376267 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26e8ea-305d-45d5-a8fb-5749241ba1c7 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:06.385325 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:06.418696 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f46e2b-e67d-4557-bcc9-67e1cbbc8b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:06.419328 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f46e2b-e67d-4557-bcc9-67e1cbbc8b38 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:06.419727 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f46e2b-e67d-4557-bcc9-67e1cbbc8b38 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:06.420011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f46e2b-e67d-4557-bcc9-67e1cbbc8b38 None admin] PATH_INFO: `/v3/users/2bcfb45b3fc3478a81cf1941e9ba32a7` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:06.420738 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da16ab-107f-4dcc-a8b7-109f434f2ba8 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:06.421861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f46e2b-e67d-4557-bcc9-67e1cbbc8b38 None admin] RBAC: Authorizing `identity:get_user(user_id=2bcfb45b3fc3478a81cf1941e9ba32a7)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:06.423466 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f46e2b-e67d-4557-bcc9-67e1cbbc8b38 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:06.429854 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 61/120] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:06 2022] GET /identity/v3/users/2bcfb45b3fc3478a81cf1941e9ba32a7 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:06.431230 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f46e2b-e67d-4557-bcc9-67e1cbbc8b38 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:06.450762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:06.466399 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f71ba3-e86c-40cc-8bc2-682972103a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:06.467339 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f71ba3-e86c-40cc-8bc2-682972103a32 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:06.468338 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f71ba3-e86c-40cc-8bc2-682972103a32 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:06.468760 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f71ba3-e86c-40cc-8bc2-682972103a32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:06.573062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f46e2b-e67d-4557-bcc9-67e1cbbc8b38 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:06.589284 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f71ba3-e86c-40cc-8bc2-682972103a32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:06.592491 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f71ba3-e86c-40cc-8bc2-682972103a32 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:06.623904 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27264e75-1e5e-485d-9ad4-e6e83cf49df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:06.624624 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27264e75-1e5e-485d-9ad4-e6e83cf49df6 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:06.624902 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27264e75-1e5e-485d-9ad4-e6e83cf49df6 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:06.625183 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27264e75-1e5e-485d-9ad4-e6e83cf49df6 None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:06.626524 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27264e75-1e5e-485d-9ad4-e6e83cf49df6 None admin] RBAC: Authorizing `identity:get_project(project_id=7bb022d88d4f49bc889242cf22018981)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:06.628131 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27264e75-1e5e-485d-9ad4-e6e83cf49df6 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:06.630254 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 62/121] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:06 2022] GET /identity/v3/projects/7bb022d88d4f49bc889242cf22018981 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:06.630914 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27264e75-1e5e-485d-9ad4-e6e83cf49df6 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:06.698971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:06.779967 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 60/122] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:28:06.782878 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f71ba3-e86c-40cc-8bc2-682972103a32 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:06.818518 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27264e75-1e5e-485d-9ad4-e6e83cf49df6 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:06.824981 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:06.867044 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954370e-c76c-4346-9643-f07d109e0f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:06.867910 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954370e-c76c-4346-9643-f07d109e0f92 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:06.868262 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954370e-c76c-4346-9643-f07d109e0f92 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:06.868550 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954370e-c76c-4346-9643-f07d109e0f92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:06.880292 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954370e-c76c-4346-9643-f07d109e0f92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:06.885177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-9954370e-c76c-4346-9643-f07d109e0f92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:06.885177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:06.885177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:06.885177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:06.885177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:06.885177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:06.885177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:06.885177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:06.885177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:06.885177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:06.885177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:06.885177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:06.885177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:06.885177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:06.885177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:06.885177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:06.895444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:06.895444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:06.895444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:06.895444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:06.895444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:06.895444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:06.895444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:06.895444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:06.895444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:06.895444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:06.895444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:06.895444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:06.895444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:06.895444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:06.895444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:06.895444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:06.897333 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:06.897333 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:06.897333 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:06.897333 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:06.897333 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:06.897333 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:06.897333 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:06.897333 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:06.897333 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:06.897333 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:06.897333 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:06.897333 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:06.897333 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 63/123] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 20:28:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:06.897333 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954370e-c76c-4346-9643-f07d109e0f92 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:06.961098 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f71ba3-e86c-40cc-8bc2-682972103a32 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:07.016431 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b648368-8fbe-4545-941c-d8a96d1899b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:07.017428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b648368-8fbe-4545-941c-d8a96d1899b2 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:07.017866 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b648368-8fbe-4545-941c-d8a96d1899b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:07.018369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b648368-8fbe-4545-941c-d8a96d1899b2 None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:07.020502 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b648368-8fbe-4545-941c-d8a96d1899b2 None admin] RBAC: Authorizing `identity:get_project(project_id=7bb022d88d4f49bc889242cf22018981)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:07.023329 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b648368-8fbe-4545-941c-d8a96d1899b2 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:07.031745 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 61/124] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:06 2022] GET /identity/v3/projects/7bb022d88d4f49bc889242cf22018981 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:07.031745 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b648368-8fbe-4545-941c-d8a96d1899b2 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:07.053637 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:07.063082 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954370e-c76c-4346-9643-f07d109e0f92 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:07.127158 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eeff84-9e5b-4b16-816e-4f6339e1fa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:07.127983 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eeff84-9e5b-4b16-816e-4f6339e1fa65 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:07.128272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eeff84-9e5b-4b16-816e-4f6339e1fa65 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:07.129410 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eeff84-9e5b-4b16-816e-4f6339e1fa65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:07.149205 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eeff84-9e5b-4b16-816e-4f6339e1fa65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:07.158968 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:07.159372 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-d2eeff84-9e5b-4b16-816e-4f6339e1fa65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:07.159372 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:07.159372 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:07.159372 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:07.159372 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:07.159372 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:07.159372 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:07.159372 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:07.159372 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:07.159372 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:07.159372 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:07.159372 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:07.159372 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:07.159372 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:07.159372 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:07.159372 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:07.161207 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:07.161207 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:07.161207 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:07.161207 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:07.161207 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:07.161207 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:07.161207 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:07.161207 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:07.161207 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:07.161207 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:07.161207 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:07.161207 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:07.161207 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:07.161207 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:07.161207 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:07.161207 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:07.164407 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:07.164407 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:07.164407 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:07.164407 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:07.164407 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:07.164407 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:07.164407 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:07.164407 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:07.164407 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:07.164407 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:07.164407 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:07.164407 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:07.164407 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 64/125] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:07.164407 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eeff84-9e5b-4b16-816e-4f6339e1fa65 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:07.178063 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b648368-8fbe-4545-941c-d8a96d1899b2 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:07.226116 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af687000-7575-4944-8c38-d07312d90b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:07.227186 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af687000-7575-4944-8c38-d07312d90b83 None admin] REQUEST_METHOD: `PUT` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:07.228026 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af687000-7575-4944-8c38-d07312d90b83 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:07.228539 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af687000-7575-4944-8c38-d07312d90b83 None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981/users/2bcfb45b3fc3478a81cf1941e9ba32a7/roles/fcd9a48e6c4b4c048380a57be435c3dd` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:07.232496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af687000-7575-4944-8c38-d07312d90b83 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bb022d88d4f49bc889242cf22018981, user_id=2bcfb45b3fc3478a81cf1941e9ba32a7, role_id=fcd9a48e6c4b4c048380a57be435c3dd)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:07.234900 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af687000-7575-4944-8c38-d07312d90b83 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:07.321050 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eeff84-9e5b-4b16-816e-4f6339e1fa65 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:07.327920 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 62/126] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 20:28:07 2022] PUT /identity/v3/projects/7bb022d88d4f49bc889242cf22018981/users/2bcfb45b3fc3478a81cf1941e9ba32a7/roles/fcd9a48e6c4b4c048380a57be435c3dd => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:28:07.327920 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af687000-7575-4944-8c38-d07312d90b83 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:07.410353 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8eb633-4346-41ea-a124-693663c99109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:07.412673 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eb633-4346-41ea-a124-693663c99109 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:07.413016 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eb633-4346-41ea-a124-693663c99109 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:07.413454 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eb633-4346-41ea-a124-693663c99109 None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:07.417101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8eb633-4346-41ea-a124-693663c99109 None admin] RBAC: Authorizing `identity:get_project(project_id=7bb022d88d4f49bc889242cf22018981)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:07.418751 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8eb633-4346-41ea-a124-693663c99109 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:07.426022 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 65/127] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:07 2022] GET /identity/v3/projects/7bb022d88d4f49bc889242cf22018981 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:07.426022 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8eb633-4346-41ea-a124-693663c99109 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:07.463314 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:07.484561 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af687000-7575-4944-8c38-d07312d90b83 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:07.551106 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320ddd9-80a8-4c39-b33e-624c07762a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:07.552236 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320ddd9-80a8-4c39-b33e-624c07762a72 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:07.552732 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320ddd9-80a8-4c39-b33e-624c07762a72 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:07.553243 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320ddd9-80a8-4c39-b33e-624c07762a72 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:07.554981 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320ddd9-80a8-4c39-b33e-624c07762a72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:07.555589 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320ddd9-80a8-4c39-b33e-624c07762a72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:07.558311 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320ddd9-80a8-4c39-b33e-624c07762a72 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:07.569682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8eb633-4346-41ea-a124-693663c99109 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:07.573594 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 63/128] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:07.575000 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320ddd9-80a8-4c39-b33e-624c07762a72 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:07.598866 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:07.628805 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4a4c7-a762-4158-9ac9-6672d741e5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:07.638542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4a4c7-a762-4158-9ac9-6672d741e5f8 None admin] REQUEST_METHOD: `PUT` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:07.638542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4a4c7-a762-4158-9ac9-6672d741e5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:07.638542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4a4c7-a762-4158-9ac9-6672d741e5f8 None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981/users/2bcfb45b3fc3478a81cf1941e9ba32a7/roles/910e8004690649e3b4fc1c4be76ad967` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:07.638542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4a4c7-a762-4158-9ac9-6672d741e5f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bb022d88d4f49bc889242cf22018981, user_id=2bcfb45b3fc3478a81cf1941e9ba32a7, role_id=910e8004690649e3b4fc1c4be76ad967)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:07.638542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4a4c7-a762-4158-9ac9-6672d741e5f8 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:07.737609 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320ddd9-80a8-4c39-b33e-624c07762a72 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:07.771580 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 66/129] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 20:28:07 2022] PUT /identity/v3/projects/7bb022d88d4f49bc889242cf22018981/users/2bcfb45b3fc3478a81cf1941e9ba32a7/roles/910e8004690649e3b4fc1c4be76ad967 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:28:07.771580 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4a4c7-a762-4158-9ac9-6672d741e5f8 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:07.814569 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e41cd-7d69-4d04-b862-e7aa2b0e576d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:07.816994 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e41cd-7d69-4d04-b862-e7aa2b0e576d None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:07.817329 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e41cd-7d69-4d04-b862-e7aa2b0e576d None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:07.817607 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e41cd-7d69-4d04-b862-e7aa2b0e576d None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:07.818335 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e41cd-7d69-4d04-b862-e7aa2b0e576d None admin] RBAC: Adding query filter params (name=member) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:07.821900 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e41cd-7d69-4d04-b862-e7aa2b0e576d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:07.824197 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e41cd-7d69-4d04-b862-e7aa2b0e576d None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:07.849173 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 64/130] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:07.850087 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e41cd-7d69-4d04-b862-e7aa2b0e576d None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:07.973773 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:08.029583 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e41cd-7d69-4d04-b862-e7aa2b0e576d None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:08.035498 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:08.074387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4a4c7-a762-4158-9ac9-6672d741e5f8 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:08.075018 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165751b-7ee0-4f12-8aa8-32d11751df1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:08.075726 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165751b-7ee0-4f12-8aa8-32d11751df1a None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:08.076015 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165751b-7ee0-4f12-8aa8-32d11751df1a None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:08.076390 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165751b-7ee0-4f12-8aa8-32d11751df1a None admin] PATH_INFO: `/v3/users/146ec9a584bf4142acfd366d51db1f8d` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:08.078394 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165751b-7ee0-4f12-8aa8-32d11751df1a None admin] RBAC: Authorizing `identity:get_user(user_id=146ec9a584bf4142acfd366d51db1f8d)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:08.080031 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165751b-7ee0-4f12-8aa8-32d11751df1a None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:08.081948 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 65/131] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:07 2022] GET /identity/v3/users/146ec9a584bf4142acfd366d51db1f8d => generated 247 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:08.082579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165751b-7ee0-4f12-8aa8-32d11751df1a None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:08.161613 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b87d1-3fd8-4d52-8914-15518deb8743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:08.163741 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b87d1-3fd8-4d52-8914-15518deb8743 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:08.164242 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b87d1-3fd8-4d52-8914-15518deb8743 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:08.169082 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b87d1-3fd8-4d52-8914-15518deb8743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:08.169082 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b87d1-3fd8-4d52-8914-15518deb8743 None admin] RBAC: Adding query filter params (role.id=147cb5e8478b42c0908186e1c2df0e55, scope.project.id=7bb022d88d4f49bc889242cf22018981, user.id=98a48729723448dba253a13398ea07dd) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:08.169082 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b87d1-3fd8-4d52-8914-15518deb8743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:08.172650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b87d1-3fd8-4d52-8914-15518deb8743 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:08.188622 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 67/132] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:28:07 2022] GET /identity/v3/role_assignments?user.id=98a48729723448dba253a13398ea07dd&scope.project.id=7bb022d88d4f49bc889242cf22018981&role.id=147cb5e8478b42c0908186e1c2df0e55 => generated 259 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:08.191688 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dfa3c-4bea-4ba2-9160-12d53f5038ca None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:08.192214 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dfa3c-4bea-4ba2-9160-12d53f5038ca None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:08.192724 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dfa3c-4bea-4ba2-9160-12d53f5038ca None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:08.196868 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 68/133] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:08.198745 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64dfa3c-4bea-4ba2-9160-12d53f5038ca None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:08.246921 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165751b-7ee0-4f12-8aa8-32d11751df1a None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:08.325388 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa362b5-8403-4efc-94fb-c54124c28e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:08.326633 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa362b5-8403-4efc-94fb-c54124c28e49 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:08.327237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa362b5-8403-4efc-94fb-c54124c28e49 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:08.327852 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa362b5-8403-4efc-94fb-c54124c28e49 None admin] PATH_INFO: `/v3/users/2bcfb45b3fc3478a81cf1941e9ba32a7` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:08.330990 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa362b5-8403-4efc-94fb-c54124c28e49 None admin] RBAC: Authorizing `identity:get_user(user_id=2bcfb45b3fc3478a81cf1941e9ba32a7)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:08.334294 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa362b5-8403-4efc-94fb-c54124c28e49 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:08.338696 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 66/134] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:08 2022] GET /identity/v3/users/2bcfb45b3fc3478a81cf1941e9ba32a7 => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:08.341231 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98407c-c6fd-4745-a61a-ab9f6dc0803a None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:08.341714 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98407c-c6fd-4745-a61a-ab9f6dc0803a None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:08.342206 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98407c-c6fd-4745-a61a-ab9f6dc0803a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:08.381560 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-2c98407c-c6fd-4745-a61a-ab9f6dc0803a None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:08.384377 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-2c98407c-c6fd-4745-a61a-ab9f6dc0803a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:08.391747 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:08.450890 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64dfa3c-4bea-4ba2-9160-12d53f5038ca None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:08.523957 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391161c2-4953-4737-984f-fc0fcb39fa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:08.525406 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391161c2-4953-4737-984f-fc0fcb39fa0f None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:08.525922 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391161c2-4953-4737-984f-fc0fcb39fa0f None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:08.526397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391161c2-4953-4737-984f-fc0fcb39fa0f None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:08.527961 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391161c2-4953-4737-984f-fc0fcb39fa0f None admin] RBAC: Authorizing `identity:get_project(project_id=7bb022d88d4f49bc889242cf22018981)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:08.534155 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391161c2-4953-4737-984f-fc0fcb39fa0f None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:08.536446 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 69/135] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:08 2022] GET /identity/v3/projects/7bb022d88d4f49bc889242cf22018981 => generated 298 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:08.537816 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391161c2-4953-4737-984f-fc0fcb39fa0f None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:08.545096 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 67/136] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:08.546982 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98407c-c6fd-4745-a61a-ab9f6dc0803a None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:08.578420 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:08.744607 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391161c2-4953-4737-984f-fc0fcb39fa0f None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:08.820535 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35901ff3-34b4-4bf2-b9e0-2ef865c21179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:08.821544 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35901ff3-34b4-4bf2-b9e0-2ef865c21179 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:08.822060 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35901ff3-34b4-4bf2-b9e0-2ef865c21179 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:08.822569 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35901ff3-34b4-4bf2-b9e0-2ef865c21179 None admin] PATH_INFO: `/v3/projects/cbee6caf478641419e1fe9e594bbfec6` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:08.828252 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35901ff3-34b4-4bf2-b9e0-2ef865c21179 None admin] RBAC: Authorizing `identity:get_project(project_id=cbee6caf478641419e1fe9e594bbfec6)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:08.830378 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35901ff3-34b4-4bf2-b9e0-2ef865c21179 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:08.837111 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 70/137] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:08 2022] GET /identity/v3/projects/cbee6caf478641419e1fe9e594bbfec6 => generated 312 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:08.841025 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35901ff3-34b4-4bf2-b9e0-2ef865c21179 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:08.858022 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98407c-c6fd-4745-a61a-ab9f6dc0803a None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:08.924348 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575498b-0289-4165-999d-8d0890578037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:08.925049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575498b-0289-4165-999d-8d0890578037 None admin] REQUEST_METHOD: `PUT` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:08.925380 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575498b-0289-4165-999d-8d0890578037 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:08.925705 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575498b-0289-4165-999d-8d0890578037 None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981/users/146ec9a584bf4142acfd366d51db1f8d/roles/1e3ce9c8b9934a7bb515b39e21fc1d68` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:08.927856 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575498b-0289-4165-999d-8d0890578037 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bb022d88d4f49bc889242cf22018981, user_id=146ec9a584bf4142acfd366d51db1f8d, role_id=1e3ce9c8b9934a7bb515b39e21fc1d68)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:08.929378 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575498b-0289-4165-999d-8d0890578037 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:09.013831 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:09.044920 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 68/138] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 20:28:08 2022] PUT /identity/v3/projects/7bb022d88d4f49bc889242cf22018981/users/146ec9a584bf4142acfd366d51db1f8d/roles/1e3ce9c8b9934a7bb515b39e21fc1d68 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:28:09.045632 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:09.055982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35901ff3-34b4-4bf2-b9e0-2ef865c21179 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:09.106103 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c7442-0168-4ce8-9bcd-686b9ac8c42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:09.106825 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c7442-0168-4ce8-9bcd-686b9ac8c42b None admin] REQUEST_METHOD: `PUT` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:09.107112 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c7442-0168-4ce8-9bcd-686b9ac8c42b None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:09.107444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c7442-0168-4ce8-9bcd-686b9ac8c42b None admin] PATH_INFO: `/v3/projects/cbee6caf478641419e1fe9e594bbfec6/users/2bcfb45b3fc3478a81cf1941e9ba32a7/roles/910e8004690649e3b4fc1c4be76ad967` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:09.111362 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c7442-0168-4ce8-9bcd-686b9ac8c42b None admin] RBAC: Authorizing `identity:create_grant(project_id=cbee6caf478641419e1fe9e594bbfec6, user_id=2bcfb45b3fc3478a81cf1941e9ba32a7, role_id=910e8004690649e3b4fc1c4be76ad967)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:09.112908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c7442-0168-4ce8-9bcd-686b9ac8c42b None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:09.142223 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575498b-0289-4165-999d-8d0890578037 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:09.250344 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 71/139] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 20:28:08 2022] PUT /identity/v3/projects/cbee6caf478641419e1fe9e594bbfec6/users/2bcfb45b3fc3478a81cf1941e9ba32a7/roles/910e8004690649e3b4fc1c4be76ad967 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:28:09.293602 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575498b-0289-4165-999d-8d0890578037 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:09.342027 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c994f67-0839-4b87-96d0-63469da0dca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:09.342700 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c994f67-0839-4b87-96d0-63469da0dca2 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:09.343681 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c994f67-0839-4b87-96d0-63469da0dca2 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:09.343967 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c994f67-0839-4b87-96d0-63469da0dca2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:09.345375 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c994f67-0839-4b87-96d0-63469da0dca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:09.346939 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c994f67-0839-4b87-96d0-63469da0dca2 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:09.348941 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 69/140] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:28:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:09.357997 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c7442-0168-4ce8-9bcd-686b9ac8c42b None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:09.540971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c7442-0168-4ce8-9bcd-686b9ac8c42b None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:09.619180 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d468914-544c-4a78-98ac-f4c7d53551b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:09.620098 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d468914-544c-4a78-98ac-f4c7d53551b6 None admin] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:09.620583 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d468914-544c-4a78-98ac-f4c7d53551b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:09.621068 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d468914-544c-4a78-98ac-f4c7d53551b6 None admin] PATH_INFO: `/v3/users` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:09.622186 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d468914-544c-4a78-98ac-f4c7d53551b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:09.625296 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d468914-544c-4a78-98ac-f4c7d53551b6 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:09.825240 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:09.834168 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 72/141] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 20:28:09 2022] POST /identity/v3/users => generated 283 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:28:11.240876 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b87303-2a54-4e4b-8da6-02cdbae20221 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:11.241674 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b87303-2a54-4e4b-8da6-02cdbae20221 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:11.241674 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b87303-2a54-4e4b-8da6-02cdbae20221 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:11.243085 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 70/142] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:28:11.257640 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e964c4-532d-40be-b0ea-dbc2ff6b3341 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:11.259312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e964c4-532d-40be-b0ea-dbc2ff6b3341 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:11.262219 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e964c4-532d-40be-b0ea-dbc2ff6b3341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:11.303408 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-10e964c4-532d-40be-b0ea-dbc2ff6b3341 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:11.305932 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-10e964c4-532d-40be-b0ea-dbc2ff6b3341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:11.431530 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 73/143] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:11.934954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90b904-1156-4825-8929-88e5e3d4056d None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:11.935248 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90b904-1156-4825-8929-88e5e3d4056d None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:11.935570 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90b904-1156-4825-8929-88e5e3d4056d None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:11.937945 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 71/144] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:28:11.956268 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a64af4-824f-482d-9895-292e1d6b7d51 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:11.956670 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a64af4-824f-482d-9895-292e1d6b7d51 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:11.956912 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a64af4-824f-482d-9895-292e1d6b7d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:11.985288 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-f0a64af4-824f-482d-9895-292e1d6b7d51 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:11.986583 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-f0a64af4-824f-482d-9895-292e1d6b7d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:12.018437 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b2ea8-b1ed-42b5-add9-5f2e820036d7 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:12.018850 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b2ea8-b1ed-42b5-add9-5f2e820036d7 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:12.018998 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b2ea8-b1ed-42b5-add9-5f2e820036d7 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:12.020724 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 72/145] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:12.043225 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9028c3-126b-4cb3-ad4c-8659f54ccdc8 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:12.043618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9028c3-126b-4cb3-ad4c-8659f54ccdc8 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:12.043850 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9028c3-126b-4cb3-ad4c-8659f54ccdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:12.075394 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-de9028c3-126b-4cb3-ad4c-8659f54ccdc8 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:12.076658 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-de9028c3-126b-4cb3-ad4c-8659f54ccdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:12.129652 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 74/146] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:12.180289 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:12.188803 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 73/147] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:28:12.602351 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a64af4-824f-482d-9895-292e1d6b7d51 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:12.705207 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9028c3-126b-4cb3-ad4c-8659f54ccdc8 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:12.708037 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:12.782349 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a64af4-824f-482d-9895-292e1d6b7d51 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:12.858575 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f00fb-e52f-459b-99e6-585fc98042b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:12.859166 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f00fb-e52f-459b-99e6-585fc98042b5 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:12.859448 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f00fb-e52f-459b-99e6-585fc98042b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:12.859744 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f00fb-e52f-459b-99e6-585fc98042b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:12.881493 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f00fb-e52f-459b-99e6-585fc98042b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:12.894713 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-5e5f00fb-e52f-459b-99e6-585fc98042b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:12.894713 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:12.894713 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:12.894713 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:12.894713 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:12.894713 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:12.894713 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:12.894713 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:12.894713 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:12.894713 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:12.894713 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:12.894713 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:12.894713 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:12.894713 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:12.894713 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:12.894713 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:12.895677 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:12.895677 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:12.895677 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:12.895677 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:12.895677 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:12.895677 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:12.895677 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:12.895677 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:12.895677 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:12.895677 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:12.895677 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:12.895677 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:12.895677 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:12.895677 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:12.895677 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:12.895677 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:12.896505 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:12.896505 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:12.896505 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:12.896505 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:12.896505 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:12.896505 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:12.896505 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:12.896505 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:12.896505 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:12.896505 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:12.896505 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:12.896505 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:12.896505 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 75/148] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:12.904470 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f00fb-e52f-459b-99e6-585fc98042b5 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:13.024895 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9028c3-126b-4cb3-ad4c-8659f54ccdc8 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:13.119720 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f00fb-e52f-459b-99e6-585fc98042b5 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:13.142829 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c898dd-28d9-497c-8d12-659fd6a75b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:13.143842 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c898dd-28d9-497c-8d12-659fd6a75b68 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:13.144321 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c898dd-28d9-497c-8d12-659fd6a75b68 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:13.144797 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c898dd-28d9-497c-8d12-659fd6a75b68 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:13.164707 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:13.180537 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c898dd-28d9-497c-8d12-659fd6a75b68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:13.190354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-42c898dd-28d9-497c-8d12-659fd6a75b68 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:28:13.190354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:13.190354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:13.190354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:13.190354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:13.190354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:13.190354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:13.190354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:13.190354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:13.190354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:13.190354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:13.190354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:13.190354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:13.190354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:13.190354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:13.190354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:13.191270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:13.191270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:13.191270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:13.191270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:13.191270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:13.191270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:13.191270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:13.191270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:13.191270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:13.191270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:13.191270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:13.191270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:13.191270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:13.191270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:13.191270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:13.191270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:13.192069 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:13.192069 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:13.192069 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:13.192069 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:13.192069 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:13.192069 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:13.192069 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:13.192069 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:13.192069 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:13.192069 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:13.192069 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:28:13.192069 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:28:13.192645 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 74/149] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 488 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:13.198026 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c898dd-28d9-497c-8d12-659fd6a75b68 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:13.212368 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a885f-0989-44f3-93c0-a9fe191896a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:13.213061 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a885f-0989-44f3-93c0-a9fe191896a6 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:13.213290 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a885f-0989-44f3-93c0-a9fe191896a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:13.213569 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a885f-0989-44f3-93c0-a9fe191896a6 None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:13.214271 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a885f-0989-44f3-93c0-a9fe191896a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:13.214574 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a885f-0989-44f3-93c0-a9fe191896a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:13.216214 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a885f-0989-44f3-93c0-a9fe191896a6 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:13.232630 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 76/150] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:13.233338 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a885f-0989-44f3-93c0-a9fe191896a6 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:13.352352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:13.451757 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c898dd-28d9-497c-8d12-659fd6a75b68 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:13.494072 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a885f-0989-44f3-93c0-a9fe191896a6 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:13.565792 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4ec84-aaf9-4f58-ad9a-15a0d5e93486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:13.566565 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4ec84-aaf9-4f58-ad9a-15a0d5e93486 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:13.566942 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4ec84-aaf9-4f58-ad9a-15a0d5e93486 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:13.567292 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4ec84-aaf9-4f58-ad9a-15a0d5e93486 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:13.590929 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4ec84-aaf9-4f58-ad9a-15a0d5e93486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:13.600355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-64a4ec84-aaf9-4f58-ad9a-15a0d5e93486 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:28:13.600355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:13.600355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:13.600355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:13.600355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:13.600355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:13.600355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:13.600355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:13.600355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:13.600355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:13.600355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:13.600355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:13.600355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:13.600355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:13.600355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:13.600355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:13.601453 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:13.601453 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:13.601453 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:13.601453 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:13.601453 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:13.601453 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:13.601453 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:13.601453 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:13.601453 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:13.601453 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:13.601453 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:13.601453 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:13.601453 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:13.601453 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:13.601453 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:13.601453 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:13.602356 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:13.602356 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:13.602356 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:13.602356 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:13.602356 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:13.602356 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:13.602356 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:13.602356 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:13.602356 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:13.602356 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:13.602356 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:28:13.602356 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:28:13.605023 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 75/151] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 20:28:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:13.606192 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4ec84-aaf9-4f58-ad9a-15a0d5e93486 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:13.612325 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a5345-92d8-4cdc-9ec9-05c2c967dd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:13.612955 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a5345-92d8-4cdc-9ec9-05c2c967dd8d None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:13.613247 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a5345-92d8-4cdc-9ec9-05c2c967dd8d None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:13.613521 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a5345-92d8-4cdc-9ec9-05c2c967dd8d None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:13.614458 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a5345-92d8-4cdc-9ec9-05c2c967dd8d None admin] RBAC: Adding query filter params (name=reader) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:13.614640 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a5345-92d8-4cdc-9ec9-05c2c967dd8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:13.616098 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a5345-92d8-4cdc-9ec9-05c2c967dd8d None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:13.637628 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 77/152] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:13.638560 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a5345-92d8-4cdc-9ec9-05c2c967dd8d None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:13.766832 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:13.800767 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4ec84-aaf9-4f58-ad9a-15a0d5e93486 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:13.822638 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:13.841881 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a8f20-3123-48df-852e-21a1efba2d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:13.848606 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a8f20-3123-48df-852e-21a1efba2d92 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:13.848606 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a8f20-3123-48df-852e-21a1efba2d92 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:13.848606 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a8f20-3123-48df-852e-21a1efba2d92 None admin] PATH_INFO: `/v3/users/2bcfb45b3fc3478a81cf1941e9ba32a7` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:13.848606 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a8f20-3123-48df-852e-21a1efba2d92 None admin] RBAC: Authorizing `identity:get_user(user_id=2bcfb45b3fc3478a81cf1941e9ba32a7)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:13.848606 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a8f20-3123-48df-852e-21a1efba2d92 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:13.848606 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 76/153] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:13 2022] GET /identity/v3/users/2bcfb45b3fc3478a81cf1941e9ba32a7 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:13.849311 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a8f20-3123-48df-852e-21a1efba2d92 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:13.935261 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a5345-92d8-4cdc-9ec9-05c2c967dd8d None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:14.041372 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59168c-6caf-4c0f-8250-b80106cece3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:14.042478 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59168c-6caf-4c0f-8250-b80106cece3a None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:14.043036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59168c-6caf-4c0f-8250-b80106cece3a None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:14.043287 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a8f20-3123-48df-852e-21a1efba2d92 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:14.043595 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59168c-6caf-4c0f-8250-b80106cece3a None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:14.049284 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59168c-6caf-4c0f-8250-b80106cece3a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:14.049810 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59168c-6caf-4c0f-8250-b80106cece3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:14.052544 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59168c-6caf-4c0f-8250-b80106cece3a None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:14.078413 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 78/154] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:28:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:14.080937 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb873a-1db3-4d39-a24a-542ac12fad88 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:14.081440 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb873a-1db3-4d39-a24a-542ac12fad88 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:14.081931 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb873a-1db3-4d39-a24a-542ac12fad88 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:14.088772 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 79/155] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:14.090212 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb873a-1db3-4d39-a24a-542ac12fad88 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:14.164626 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b193e6-050a-43f5-b60e-a0b63c3b6d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:14.165708 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b193e6-050a-43f5-b60e-a0b63c3b6d02 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:14.166201 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b193e6-050a-43f5-b60e-a0b63c3b6d02 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:14.166760 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b193e6-050a-43f5-b60e-a0b63c3b6d02 None admin] PATH_INFO: `/v3/users/98a48729723448dba253a13398ea07dd` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:14.170670 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b193e6-050a-43f5-b60e-a0b63c3b6d02 None admin] RBAC: Authorizing `identity:get_user(user_id=98a48729723448dba253a13398ea07dd)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:14.174740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b193e6-050a-43f5-b60e-a0b63c3b6d02 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:14.184165 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 77/156] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:13 2022] GET /identity/v3/users/98a48729723448dba253a13398ea07dd => generated 289 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:14.185541 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5d9fe-929e-42e3-af01-90f1e71afea3 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:14.185976 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5d9fe-929e-42e3-af01-90f1e71afea3 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:14.186151 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5d9fe-929e-42e3-af01-90f1e71afea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:14.220649 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-5bd5d9fe-929e-42e3-af01-90f1e71afea3 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:14.221873 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-5bd5d9fe-929e-42e3-af01-90f1e71afea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:14.285346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:14.320178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 78/157] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:14.321702 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5d9fe-929e-42e3-af01-90f1e71afea3 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:14.399098 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb873a-1db3-4d39-a24a-542ac12fad88 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:14.418443 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:14.551794 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0caa1-7668-4eb9-b134-b4e1e76b01c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:14.553663 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0caa1-7668-4eb9-b134-b4e1e76b01c3 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:14.554360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0caa1-7668-4eb9-b134-b4e1e76b01c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:14.555268 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0caa1-7668-4eb9-b134-b4e1e76b01c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:14.607336 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5d9fe-929e-42e3-af01-90f1e71afea3 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:14.728778 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ded3b-6b31-4c5f-8264-f775136c1107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:14.729817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ded3b-6b31-4c5f-8264-f775136c1107 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:14.730296 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ded3b-6b31-4c5f-8264-f775136c1107 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:14.730766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ded3b-6b31-4c5f-8264-f775136c1107 None admin] PATH_INFO: `/v3/users/2bcfb45b3fc3478a81cf1941e9ba32a7` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:14.732819 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ded3b-6b31-4c5f-8264-f775136c1107 None admin] RBAC: Authorizing `identity:get_user(user_id=2bcfb45b3fc3478a81cf1941e9ba32a7)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:14.736032 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ded3b-6b31-4c5f-8264-f775136c1107 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:14.738856 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 79/158] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:14 2022] GET /identity/v3/users/2bcfb45b3fc3478a81cf1941e9ba32a7 => generated 275 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:14.745112 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ded3b-6b31-4c5f-8264-f775136c1107 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:14.771840 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0caa1-7668-4eb9-b134-b4e1e76b01c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:14.776078 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0caa1-7668-4eb9-b134-b4e1e76b01c3 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:14.955206 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:15.029323 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ded3b-6b31-4c5f-8264-f775136c1107 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:15.095165 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 80/159] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1005 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:28:15.103121 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2f2b3-90e0-4441-a13b-a030c10d6128 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:15.104434 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2f2b3-90e0-4441-a13b-a030c10d6128 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:15.104682 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b36538-932e-4976-99e0-d39218ccc0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:15.108073 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2f2b3-90e0-4441-a13b-a030c10d6128 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:15.108213 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b36538-932e-4976-99e0-d39218ccc0f5 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:15.108213 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b36538-932e-4976-99e0-d39218ccc0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:15.108213 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b36538-932e-4976-99e0-d39218ccc0f5 None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:15.111916 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b36538-932e-4976-99e0-d39218ccc0f5 None admin] RBAC: Authorizing `identity:get_project(project_id=7bb022d88d4f49bc889242cf22018981)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:15.113474 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 81/160] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:15 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:15.115001 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b36538-932e-4976-99e0-d39218ccc0f5 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:15.115448 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2f2b3-90e0-4441-a13b-a030c10d6128 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:15.129929 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 80/161] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:14 2022] GET /identity/v3/projects/7bb022d88d4f49bc889242cf22018981 => generated 298 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:15.129929 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b36538-932e-4976-99e0-d39218ccc0f5 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:15.150050 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:15.300581 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b36538-932e-4976-99e0-d39218ccc0f5 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:15.345811 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:15.381218 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfb2d9-9557-4d56-81c8-c5d750d09409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:15.382775 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfb2d9-9557-4d56-81c8-c5d750d09409 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:15.383062 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfb2d9-9557-4d56-81c8-c5d750d09409 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:15.383338 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfb2d9-9557-4d56-81c8-c5d750d09409 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:15.399854 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2f2b3-90e0-4441-a13b-a030c10d6128 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:15.408223 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfb2d9-9557-4d56-81c8-c5d750d09409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:15.417922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-32dfb2d9-9557-4d56-81c8-c5d750d09409 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:15.417922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:15.417922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:15.417922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:15.417922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:15.417922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:15.417922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:15.417922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:15.417922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:15.417922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:15.417922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:15.417922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:15.417922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:15.417922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:15.417922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:15.417922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:15.418937 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:15.418937 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:15.418937 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:15.418937 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:15.418937 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:15.418937 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:15.418937 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:15.418937 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:15.418937 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:15.418937 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:15.418937 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:15.418937 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:15.418937 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:15.418937 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:15.418937 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:15.418937 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:15.419718 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:15.419718 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:15.419718 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:15.419718 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:15.419718 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:15.419718 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:15.419718 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:15.419718 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:15.419718 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:15.419718 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:15.419718 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:15.419718 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:28:15.423308 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 81/162] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:15.423308 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfb2d9-9557-4d56-81c8-c5d750d09409 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:15.477633 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92362b-6241-453f-abbe-089b760275ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:15.478260 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92362b-6241-453f-abbe-089b760275ec None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:15.478591 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92362b-6241-453f-abbe-089b760275ec None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:15.478868 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92362b-6241-453f-abbe-089b760275ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:15.583322 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92362b-6241-453f-abbe-089b760275ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:15.584840 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92362b-6241-453f-abbe-089b760275ec None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:15.595985 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:15.636924 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfb2d9-9557-4d56-81c8-c5d750d09409 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:15.678894 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88f154-d936-4a0e-bc1f-083e7a7d56b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:15.679560 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88f154-d936-4a0e-bc1f-083e7a7d56b4 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:15.679880 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88f154-d936-4a0e-bc1f-083e7a7d56b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:15.680182 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88f154-d936-4a0e-bc1f-083e7a7d56b4 None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:15.681404 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88f154-d936-4a0e-bc1f-083e7a7d56b4 None admin] RBAC: Authorizing `identity:get_project(project_id=7bb022d88d4f49bc889242cf22018981)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:15.683170 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88f154-d936-4a0e-bc1f-083e7a7d56b4 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:15.685214 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 82/163] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:15 2022] GET /identity/v3/projects/7bb022d88d4f49bc889242cf22018981 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:15.686403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6174cc-1eb3-4df3-9627-5dd1b166c20b None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:15.686724 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6174cc-1eb3-4df3-9627-5dd1b166c20b None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:15.687000 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6174cc-1eb3-4df3-9627-5dd1b166c20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:15.707588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-ca6174cc-1eb3-4df3-9627-5dd1b166c20b None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:15.708900 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-ca6174cc-1eb3-4df3-9627-5dd1b166c20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:15.761791 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:15.781284 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 82/164] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:28:15.789707 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92362b-6241-453f-abbe-089b760275ec None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:15.793366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 83/165] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:15.793366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6174cc-1eb3-4df3-9627-5dd1b166c20b None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:15.909386 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6174cc-1eb3-4df3-9627-5dd1b166c20b None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:15.960433 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee59e1-b6c9-4f76-a397-ef5a0a823891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:15.961457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee59e1-b6c9-4f76-a397-ef5a0a823891 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:15.961457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee59e1-b6c9-4f76-a397-ef5a0a823891 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:15.961708 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee59e1-b6c9-4f76-a397-ef5a0a823891 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:15.962791 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee59e1-b6c9-4f76-a397-ef5a0a823891 None admin] RBAC: Adding query filter params (name=member) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:15.962791 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee59e1-b6c9-4f76-a397-ef5a0a823891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:15.965222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee59e1-b6c9-4f76-a397-ef5a0a823891 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:15.985821 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 84/166] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:15.987327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaff4b5-4b79-4754-8caa-50ab8c74aa5a None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:15.987636 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaff4b5-4b79-4754-8caa-50ab8c74aa5a None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:15.987909 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaff4b5-4b79-4754-8caa-50ab8c74aa5a None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:15.989176 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 85/167] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:15.989892 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaff4b5-4b79-4754-8caa-50ab8c74aa5a None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:16.019722 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92362b-6241-453f-abbe-089b760275ec None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:16.031997 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:16.069031 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0aad5-444e-4bba-ba3a-60306b24fe03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:16.069828 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0aad5-444e-4bba-ba3a-60306b24fe03 None admin] REQUEST_METHOD: `PUT` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:16.070106 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0aad5-444e-4bba-ba3a-60306b24fe03 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:16.070378 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0aad5-444e-4bba-ba3a-60306b24fe03 None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981/users/98a48729723448dba253a13398ea07dd/roles/147cb5e8478b42c0908186e1c2df0e55` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:16.073468 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0aad5-444e-4bba-ba3a-60306b24fe03 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bb022d88d4f49bc889242cf22018981, user_id=98a48729723448dba253a13398ea07dd, role_id=147cb5e8478b42c0908186e1c2df0e55)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:16.076312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0aad5-444e-4bba-ba3a-60306b24fe03 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:16.083514 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:16.166748 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaff4b5-4b79-4754-8caa-50ab8c74aa5a None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:16.168875 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 83/168] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 20:28:15 2022] PUT /identity/v3/projects/7bb022d88d4f49bc889242cf22018981/users/98a48729723448dba253a13398ea07dd/roles/147cb5e8478b42c0908186e1c2df0e55 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:28:16.175116 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0aad5-444e-4bba-ba3a-60306b24fe03 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:16.268725 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa74845-4468-417e-b645-7aa1de6e5b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:16.269370 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa74845-4468-417e-b645-7aa1de6e5b43 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:16.269659 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa74845-4468-417e-b645-7aa1de6e5b43 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:16.269939 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa74845-4468-417e-b645-7aa1de6e5b43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:16.270705 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa74845-4468-417e-b645-7aa1de6e5b43 None admin] RBAC: Adding query filter params (role.id=910e8004690649e3b4fc1c4be76ad967, scope.project.id=7bb022d88d4f49bc889242cf22018981, user.id=2bcfb45b3fc3478a81cf1941e9ba32a7) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:16.271024 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa74845-4468-417e-b645-7aa1de6e5b43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:16.273062 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa74845-4468-417e-b645-7aa1de6e5b43 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:16.280434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 86/169] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:28:15 2022] GET /identity/v3/role_assignments?user.id=2bcfb45b3fc3478a81cf1941e9ba32a7&scope.project.id=7bb022d88d4f49bc889242cf22018981&role.id=910e8004690649e3b4fc1c4be76ad967 => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:16.281578 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02976a-0b9b-4f5d-8872-97db10bc4dae None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:16.281879 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02976a-0b9b-4f5d-8872-97db10bc4dae None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:16.282159 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02976a-0b9b-4f5d-8872-97db10bc4dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:16.290432 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0aad5-444e-4bba-ba3a-60306b24fe03 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:16.303419 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-1c02976a-0b9b-4f5d-8872-97db10bc4dae None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:16.304814 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-1c02976a-0b9b-4f5d-8872-97db10bc4dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:16.341262 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835c987-a9cc-42c8-b547-53ddf9e0985f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:16.342576 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835c987-a9cc-42c8-b547-53ddf9e0985f None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:16.342906 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835c987-a9cc-42c8-b547-53ddf9e0985f None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:16.345999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835c987-a9cc-42c8-b547-53ddf9e0985f None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:16.345999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835c987-a9cc-42c8-b547-53ddf9e0985f None admin] RBAC: Authorizing `identity:get_project(project_id=7bb022d88d4f49bc889242cf22018981)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:16.347502 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835c987-a9cc-42c8-b547-53ddf9e0985f None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:16.349398 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 84/170] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:16 2022] GET /identity/v3/projects/7bb022d88d4f49bc889242cf22018981 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:16.350257 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835c987-a9cc-42c8-b547-53ddf9e0985f None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:16.397756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 87/171] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:16.399625 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7389379-de68-4ba2-834d-0c451a6aaf4c None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:16.400191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7389379-de68-4ba2-834d-0c451a6aaf4c None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:16.400702 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7389379-de68-4ba2-834d-0c451a6aaf4c None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:16.402355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 88/172] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:16.404138 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bfa2e-a9de-4df7-a042-aa8bd5a7ad69 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:16.404610 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bfa2e-a9de-4df7-a042-aa8bd5a7ad69 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:16.405082 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bfa2e-a9de-4df7-a042-aa8bd5a7ad69 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:16.406799 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:16.413259 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 89/173] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:16.414916 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85bfa2e-a9de-4df7-a042-aa8bd5a7ad69 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:16.500242 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:16.578293 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835c987-a9cc-42c8-b547-53ddf9e0985f None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:16.632941 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85bfa2e-a9de-4df7-a042-aa8bd5a7ad69 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:16.643384 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381e7a7-1181-44de-b511-92f345a92cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:16.644523 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381e7a7-1181-44de-b511-92f345a92cc4 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:16.645023 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381e7a7-1181-44de-b511-92f345a92cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:16.645507 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381e7a7-1181-44de-b511-92f345a92cc4 None admin] PATH_INFO: `/v3/users/2bcfb45b3fc3478a81cf1941e9ba32a7` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:16.648816 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381e7a7-1181-44de-b511-92f345a92cc4 None admin] RBAC: Authorizing `identity:get_user(user_id=2bcfb45b3fc3478a81cf1941e9ba32a7)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:16.652745 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381e7a7-1181-44de-b511-92f345a92cc4 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:16.657129 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 85/174] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:16 2022] GET /identity/v3/users/2bcfb45b3fc3478a81cf1941e9ba32a7 => generated 275 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:16.658335 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381e7a7-1181-44de-b511-92f345a92cc4 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:16.711566 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219d89d-cc44-42f9-8272-06b0f87052fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:16.712773 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219d89d-cc44-42f9-8272-06b0f87052fa None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:16.713234 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219d89d-cc44-42f9-8272-06b0f87052fa None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:16.713519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219d89d-cc44-42f9-8272-06b0f87052fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:16.735340 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219d89d-cc44-42f9-8272-06b0f87052fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:16.745073 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-a219d89d-cc44-42f9-8272-06b0f87052fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:16.745073 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:16.745073 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:16.745073 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:16.745073 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:16.745073 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:16.745073 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:16.745073 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:16.745073 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:16.745073 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:16.745073 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:16.745073 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:16.745073 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:16.745073 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:16.745073 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:16.745073 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:16.746020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:16.746020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:16.746020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:16.746020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:16.746020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:16.746020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:16.746020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:16.746020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:16.746020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:16.746020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:16.746020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:16.746020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:16.746020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:16.746020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:16.746020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:16.746020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:16.746803 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:16.746803 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:16.746803 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:16.746803 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:16.746803 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:16.746803 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:16.746803 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:16.746803 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:16.746803 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:16.746803 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:16.746803 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:16.746803 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:28:16.748045 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 90/175] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 20:28:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:16.750373 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0c0d5-0dac-4718-b782-e55570c0349f None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:16.750798 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0c0d5-0dac-4718-b782-e55570c0349f None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:16.751294 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0c0d5-0dac-4718-b782-e55570c0349f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:16.785113 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-9fe0c0d5-0dac-4718-b782-e55570c0349f None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:16.787340 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-9fe0c0d5-0dac-4718-b782-e55570c0349f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:16.869650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381e7a7-1181-44de-b511-92f345a92cc4 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:16.873199 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:16.897542 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 91/176] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:16.899250 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d7d33-1375-4393-94a0-d47ed1bf38b2 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:16.899805 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d7d33-1375-4393-94a0-d47ed1bf38b2 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:16.900088 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d7d33-1375-4393-94a0-d47ed1bf38b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:16.922408 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-fa4d7d33-1375-4393-94a0-d47ed1bf38b2 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:16.923693 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-fa4d7d33-1375-4393-94a0-d47ed1bf38b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:16.947352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:16.963112 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb25aa-d746-41a2-8503-cc2ec53b302a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:16.965237 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb25aa-d746-41a2-8503-cc2ec53b302a None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:16.969175 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb25aa-d746-41a2-8503-cc2ec53b302a None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:16.969175 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb25aa-d746-41a2-8503-cc2ec53b302a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:16.969175 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb25aa-d746-41a2-8503-cc2ec53b302a None admin] RBAC: Adding query filter params (role.id=fcd9a48e6c4b4c048380a57be435c3dd, scope.project.id=7bb022d88d4f49bc889242cf22018981, user.id=2bcfb45b3fc3478a81cf1941e9ba32a7) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:16.971222 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb25aa-d746-41a2-8503-cc2ec53b302a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:16.974063 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb25aa-d746-41a2-8503-cc2ec53b302a None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:16.989227 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 86/177] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:28:16 2022] GET /identity/v3/role_assignments?user.id=2bcfb45b3fc3478a81cf1941e9ba32a7&scope.project.id=7bb022d88d4f49bc889242cf22018981&role.id=fcd9a48e6c4b4c048380a57be435c3dd => generated 608 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:16.991275 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb25aa-d746-41a2-8503-cc2ec53b302a None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:17.029050 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 92/178] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:17.036233 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d7d33-1375-4393-94a0-d47ed1bf38b2 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:17.241016 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb25aa-d746-41a2-8503-cc2ec53b302a None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:17.284790 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fadae-934b-48d3-bd86-7848ca093bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:17.285464 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fadae-934b-48d3-bd86-7848ca093bb0 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:17.285820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fadae-934b-48d3-bd86-7848ca093bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:17.286171 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fadae-934b-48d3-bd86-7848ca093bb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:17.292935 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d7d33-1375-4393-94a0-d47ed1bf38b2 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:17.337353 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b74e35-ba55-4b75-9fc6-91688da90658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:17.338392 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b74e35-ba55-4b75-9fc6-91688da90658 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:17.339179 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b74e35-ba55-4b75-9fc6-91688da90658 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:17.339734 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b74e35-ba55-4b75-9fc6-91688da90658 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:17.340674 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b74e35-ba55-4b75-9fc6-91688da90658 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:17.341193 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b74e35-ba55-4b75-9fc6-91688da90658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:17.341319 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:17.344178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b74e35-ba55-4b75-9fc6-91688da90658 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:17.360662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 93/179] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:17.361884 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b74e35-ba55-4b75-9fc6-91688da90658 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:17.395995 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:17.424508 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fadae-934b-48d3-bd86-7848ca093bb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:17.427692 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fadae-934b-48d3-bd86-7848ca093bb0 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:17.556375 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b74e35-ba55-4b75-9fc6-91688da90658 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:17.623455 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2240613-ebcf-4ef2-9bdc-ac8917efdff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:17.624700 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2240613-ebcf-4ef2-9bdc-ac8917efdff5 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:17.625151 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2240613-ebcf-4ef2-9bdc-ac8917efdff5 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:17.625438 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2240613-ebcf-4ef2-9bdc-ac8917efdff5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:17.642547 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 87/180] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:28:17.643585 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fadae-934b-48d3-bd86-7848ca093bb0 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:17.650027 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2240613-ebcf-4ef2-9bdc-ac8917efdff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:17.662237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-f2240613-ebcf-4ef2-9bdc-ac8917efdff5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:17.662237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:17.662237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:17.662237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:17.662237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:17.662237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:17.662237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:17.662237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:17.662237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:17.662237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:17.662237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:17.662237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:17.662237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:17.662237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:17.662237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:17.662237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:17.663198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:17.663198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:17.663198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:17.663198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:17.663198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:17.663198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:17.663198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:17.663198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:17.663198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:17.663198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:17.663198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:17.663198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:17.663198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:17.663198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:17.663198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:17.663198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:17.664007 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:17.664007 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:17.664007 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:17.664007 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:17.664007 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:17.664007 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:17.664007 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:17.664007 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:17.664007 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:17.664007 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:17.664007 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:17.664007 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:28:17.664728 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 94/181] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 20:28:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:17.666169 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2240613-ebcf-4ef2-9bdc-ac8917efdff5 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:17.746157 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:17.789951 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:17.804045 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fadae-934b-48d3-bd86-7848ca093bb0 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:17.817259 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2240613-ebcf-4ef2-9bdc-ac8917efdff5 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:17.854741 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61dab3-bfaa-4817-a4b0-284f101fa840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:17.855398 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61dab3-bfaa-4817-a4b0-284f101fa840 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:17.855714 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61dab3-bfaa-4817-a4b0-284f101fa840 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:17.855985 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61dab3-bfaa-4817-a4b0-284f101fa840 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:17.862356 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e8bfd-5ba8-4a3e-9eed-90ef0a193401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:17.863261 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e8bfd-5ba8-4a3e-9eed-90ef0a193401 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:17.863718 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e8bfd-5ba8-4a3e-9eed-90ef0a193401 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:17.864176 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e8bfd-5ba8-4a3e-9eed-90ef0a193401 None admin] PATH_INFO: `/v3/users/146ec9a584bf4142acfd366d51db1f8d` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:17.865836 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e8bfd-5ba8-4a3e-9eed-90ef0a193401 None admin] RBAC: Authorizing `identity:get_user(user_id=146ec9a584bf4142acfd366d51db1f8d)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:17.867371 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e8bfd-5ba8-4a3e-9eed-90ef0a193401 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:17.869180 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61dab3-bfaa-4817-a4b0-284f101fa840 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:17.869321 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 95/182] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:17 2022] GET /identity/v3/users/146ec9a584bf4142acfd366d51db1f8d => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:17.870674 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e8bfd-5ba8-4a3e-9eed-90ef0a193401 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:17.875301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-cb61dab3-bfaa-4817-a4b0-284f101fa840 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:28:17.875301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:17.875301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:17.875301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:17.875301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:17.875301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:17.875301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:17.875301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:17.875301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:17.875301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:17.875301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:17.875301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:17.875301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:17.875301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:17.875301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:17.875301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:17.876542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:17.876542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:17.876542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:17.876542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:17.876542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:17.876542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:17.876542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:17.876542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:17.876542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:17.876542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:17.876542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:17.876542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:17.876542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:17.876542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:17.876542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:17.876542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:17.877305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:17.877305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:17.877305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:17.877305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:17.877305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:17.877305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:17.877305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:17.877305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:17.877305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:17.877305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:17.877305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:28:17.877305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:17.879281 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 88/183] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 20:28:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:17.880314 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61dab3-bfaa-4817-a4b0-284f101fa840 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:18.017675 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e8bfd-5ba8-4a3e-9eed-90ef0a193401 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:18.023353 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61dab3-bfaa-4817-a4b0-284f101fa840 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:18.056634 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:18.063968 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98415079-37b9-47ea-8ed5-624eb3ac1a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:18.065268 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98415079-37b9-47ea-8ed5-624eb3ac1a0d None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:18.065688 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98415079-37b9-47ea-8ed5-624eb3ac1a0d None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:18.066134 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98415079-37b9-47ea-8ed5-624eb3ac1a0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:18.067441 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98415079-37b9-47ea-8ed5-624eb3ac1a0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:18.068029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99c334-3a2f-4678-a983-e4f9be9f9f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:18.073823 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99c334-3a2f-4678-a983-e4f9be9f9f38 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:18.073823 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99c334-3a2f-4678-a983-e4f9be9f9f38 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:18.073823 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99c334-3a2f-4678-a983-e4f9be9f9f38 None admin] PATH_INFO: `/v3/projects/cbee6caf478641419e1fe9e594bbfec6` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:18.074049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98415079-37b9-47ea-8ed5-624eb3ac1a0d None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:18.074138 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99c334-3a2f-4678-a983-e4f9be9f9f38 None admin] RBAC: Authorizing `identity:get_project(project_id=cbee6caf478641419e1fe9e594bbfec6)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:18.074208 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 96/184] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:28:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:18.074208 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98415079-37b9-47ea-8ed5-624eb3ac1a0d None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:18.074321 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99c334-3a2f-4678-a983-e4f9be9f9f38 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:18.076646 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 89/185] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:17 2022] GET /identity/v3/projects/cbee6caf478641419e1fe9e594bbfec6 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:18.078121 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99c334-3a2f-4678-a983-e4f9be9f9f38 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:18.104843 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:18.225356 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99c334-3a2f-4678-a983-e4f9be9f9f38 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:18.265053 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad317375-0461-4b30-a76d-509a68091fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:18.265663 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad317375-0461-4b30-a76d-509a68091fb6 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:18.265939 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad317375-0461-4b30-a76d-509a68091fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:18.266212 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad317375-0461-4b30-a76d-509a68091fb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:18.274379 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98415079-37b9-47ea-8ed5-624eb3ac1a0d None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:18.339529 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:18.341218 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a012e2-f92a-4356-9690-479a8c48dec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:18.342280 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a012e2-f92a-4356-9690-479a8c48dec5 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:18.342780 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a012e2-f92a-4356-9690-479a8c48dec5 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:18.343830 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a012e2-f92a-4356-9690-479a8c48dec5 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:18.345082 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a012e2-f92a-4356-9690-479a8c48dec5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:18.345630 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a012e2-f92a-4356-9690-479a8c48dec5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:18.348329 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a012e2-f92a-4356-9690-479a8c48dec5 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:18.350219 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad317375-0461-4b30-a76d-509a68091fb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:18.351738 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad317375-0461-4b30-a76d-509a68091fb6 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:18.372247 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 97/186] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:18.372247 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a012e2-f92a-4356-9690-479a8c48dec5 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:18.507911 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:18.516547 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 90/187] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:28:18.517678 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad317375-0461-4b30-a76d-509a68091fb6 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:18.568045 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a012e2-f92a-4356-9690-479a8c48dec5 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:18.628864 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242b586-8312-4872-a3ce-2b586ed21c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:18.629765 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242b586-8312-4872-a3ce-2b586ed21c71 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:18.630210 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242b586-8312-4872-a3ce-2b586ed21c71 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:18.630660 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242b586-8312-4872-a3ce-2b586ed21c71 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:18.631846 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242b586-8312-4872-a3ce-2b586ed21c71 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:18.632350 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242b586-8312-4872-a3ce-2b586ed21c71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:18.634686 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242b586-8312-4872-a3ce-2b586ed21c71 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:18.648880 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 98/188] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:28:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:18.650239 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242b586-8312-4872-a3ce-2b586ed21c71 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:18.694005 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:18.707945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad317375-0461-4b30-a76d-509a68091fb6 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:18.772022 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3b599-d156-4a67-a9df-42c7e54ff640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:18.773062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3b599-d156-4a67-a9df-42c7e54ff640 None admin] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:18.773552 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3b599-d156-4a67-a9df-42c7e54ff640 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:18.774024 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3b599-d156-4a67-a9df-42c7e54ff640 None admin] PATH_INFO: `/v3/users` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:18.775227 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3b599-d156-4a67-a9df-42c7e54ff640 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:18.778003 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3b599-d156-4a67-a9df-42c7e54ff640 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:18.789850 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242b586-8312-4872-a3ce-2b586ed21c71 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:18.833297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8c546-4c45-4fde-aefd-37ae2809bf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:18.834033 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8c546-4c45-4fde-aefd-37ae2809bf83 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:18.834349 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8c546-4c45-4fde-aefd-37ae2809bf83 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:18.834656 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8c546-4c45-4fde-aefd-37ae2809bf83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:18.835425 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8c546-4c45-4fde-aefd-37ae2809bf83 None admin] RBAC: Adding query filter params (role.id=910e8004690649e3b4fc1c4be76ad967, scope.project.id=cbee6caf478641419e1fe9e594bbfec6, user.id=2bcfb45b3fc3478a81cf1941e9ba32a7) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:18.835806 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8c546-4c45-4fde-aefd-37ae2809bf83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:18.837515 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8c546-4c45-4fde-aefd-37ae2809bf83 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:18.841095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:18.846738 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 99/189] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:28:18 2022] GET /identity/v3/role_assignments?user.id=2bcfb45b3fc3478a81cf1941e9ba32a7&scope.project.id=cbee6caf478641419e1fe9e594bbfec6&role.id=910e8004690649e3b4fc1c4be76ad967 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:18.847880 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8c546-4c45-4fde-aefd-37ae2809bf83 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:18.984525 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 91/190] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 20:28:18 2022] POST /identity/v3/users => generated 297 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:28:18.986792 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3b599-d156-4a67-a9df-42c7e54ff640 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:19.058241 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8c546-4c45-4fde-aefd-37ae2809bf83 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:19.151345 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845cc3d6-ee9b-4f9c-b97f-0a621c8ac45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:19.152525 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cc3d6-ee9b-4f9c-b97f-0a621c8ac45c None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:19.152975 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cc3d6-ee9b-4f9c-b97f-0a621c8ac45c None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:19.153996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cc3d6-ee9b-4f9c-b97f-0a621c8ac45c None admin] PATH_INFO: `/v3/users/a67df8a580e643139ad1366b40106e72` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:19.163431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3b599-d156-4a67-a9df-42c7e54ff640 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:19.186491 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845cc3d6-ee9b-4f9c-b97f-0a621c8ac45c None admin] RBAC: Authorizing `identity:get_user(user_id=a67df8a580e643139ad1366b40106e72)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:19.191501 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845cc3d6-ee9b-4f9c-b97f-0a621c8ac45c None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:19.195708 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 100/191] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:18 2022] GET /identity/v3/users/a67df8a580e643139ad1366b40106e72 => generated 283 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:19.197243 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845cc3d6-ee9b-4f9c-b97f-0a621c8ac45c None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:19.250936 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41138d-4061-465c-bbba-6d1d7ded2692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:19.251982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41138d-4061-465c-bbba-6d1d7ded2692 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:19.252446 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41138d-4061-465c-bbba-6d1d7ded2692 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:19.252900 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41138d-4061-465c-bbba-6d1d7ded2692 None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:19.256158 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41138d-4061-465c-bbba-6d1d7ded2692 None admin] RBAC: Authorizing `identity:get_project(project_id=7bb022d88d4f49bc889242cf22018981)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:19.258796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41138d-4061-465c-bbba-6d1d7ded2692 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:19.261824 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 92/192] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:18 2022] GET /identity/v3/projects/7bb022d88d4f49bc889242cf22018981 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:19.263215 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41138d-4061-465c-bbba-6d1d7ded2692 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:19.288258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:19.312657 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:19.329076 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845cc3d6-ee9b-4f9c-b97f-0a621c8ac45c None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:19.369671 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a51d5-fdc8-41d1-b67c-62b7f3aca8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:19.387959 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a51d5-fdc8-41d1-b67c-62b7f3aca8b6 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:19.387959 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a51d5-fdc8-41d1-b67c-62b7f3aca8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:19.387959 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a51d5-fdc8-41d1-b67c-62b7f3aca8b6 None admin] PATH_INFO: `/v3/users/a67df8a580e643139ad1366b40106e72` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:19.387959 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a51d5-fdc8-41d1-b67c-62b7f3aca8b6 None admin] RBAC: Authorizing `identity:get_user(user_id=a67df8a580e643139ad1366b40106e72)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:19.387959 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a51d5-fdc8-41d1-b67c-62b7f3aca8b6 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:19.387959 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 101/193] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:19 2022] GET /identity/v3/users/a67df8a580e643139ad1366b40106e72 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:19.389025 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a51d5-fdc8-41d1-b67c-62b7f3aca8b6 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:19.476331 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41138d-4061-465c-bbba-6d1d7ded2692 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:19.549011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571143ac-447d-4c52-8d3a-be61af37cd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:19.550151 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571143ac-447d-4c52-8d3a-be61af37cd6a None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:19.550414 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571143ac-447d-4c52-8d3a-be61af37cd6a None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:19.550843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571143ac-447d-4c52-8d3a-be61af37cd6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:19.579871 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a51d5-fdc8-41d1-b67c-62b7f3aca8b6 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:19.644172 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:19.652684 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc1409-950b-44de-ac65-07a3f7dd8406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:19.653815 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc1409-950b-44de-ac65-07a3f7dd8406 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:19.654319 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc1409-950b-44de-ac65-07a3f7dd8406 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:19.654808 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc1409-950b-44de-ac65-07a3f7dd8406 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:19.656504 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc1409-950b-44de-ac65-07a3f7dd8406 None admin] RBAC: Adding query filter params (role.id=1e3ce9c8b9934a7bb515b39e21fc1d68, scope.project.id=7bb022d88d4f49bc889242cf22018981, user.id=146ec9a584bf4142acfd366d51db1f8d) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:19.657068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc1409-950b-44de-ac65-07a3f7dd8406 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:19.659852 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc1409-950b-44de-ac65-07a3f7dd8406 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:19.660068 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571143ac-447d-4c52-8d3a-be61af37cd6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:19.661565 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571143ac-447d-4c52-8d3a-be61af37cd6a None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:19.672434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 102/194] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:28:19 2022] GET /identity/v3/role_assignments?user.id=146ec9a584bf4142acfd366d51db1f8d&scope.project.id=7bb022d88d4f49bc889242cf22018981&role.id=1e3ce9c8b9934a7bb515b39e21fc1d68 => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:19.674854 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac76e5-c0d1-465e-8909-9b38478e6e2b None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:19.675364 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac76e5-c0d1-465e-8909-9b38478e6e2b None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:19.675890 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac76e5-c0d1-465e-8909-9b38478e6e2b None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:19.678474 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 103/195] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:19.680285 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac76e5-c0d1-465e-8909-9b38478e6e2b None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:19.708197 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:19.830820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 93/196] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:28:19.833588 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92896d1-1675-4fc8-bce3-68aa62f38eb7 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:19.834362 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92896d1-1675-4fc8-bce3-68aa62f38eb7 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:19.835050 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92896d1-1675-4fc8-bce3-68aa62f38eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:19.882773 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-d92896d1-1675-4fc8-bce3-68aa62f38eb7 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:19.885787 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-d92896d1-1675-4fc8-bce3-68aa62f38eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:20.026436 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac76e5-c0d1-465e-8909-9b38478e6e2b None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:20.077592 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 94/197] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:20.080387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92896d1-1675-4fc8-bce3-68aa62f38eb7 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:20.109585 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492a8f4-1c25-46d9-8687-ffa362539b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:20.110034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492a8f4-1c25-46d9-8687-ffa362539b75 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:20.110320 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492a8f4-1c25-46d9-8687-ffa362539b75 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:20.110593 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492a8f4-1c25-46d9-8687-ffa362539b75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:20.195280 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:20.253334 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:20.288212 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492a8f4-1c25-46d9-8687-ffa362539b75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:20.291351 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492a8f4-1c25-46d9-8687-ffa362539b75 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:20.316859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92896d1-1675-4fc8-bce3-68aa62f38eb7 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:20.407641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a831f2-e7fe-4116-b317-0e4f1234ae4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:20.409172 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a831f2-e7fe-4116-b317-0e4f1234ae4a None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:20.415228 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a831f2-e7fe-4116-b317-0e4f1234ae4a None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:20.416090 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a831f2-e7fe-4116-b317-0e4f1234ae4a None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:20.418368 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a831f2-e7fe-4116-b317-0e4f1234ae4a None admin] RBAC: Authorizing `identity:get_project(project_id=45f63f10100747b9b9eaf0e3e8021980)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:20.421210 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a831f2-e7fe-4116-b317-0e4f1234ae4a None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:20.426601 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 95/198] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:20 2022] GET /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980 => generated 302 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:20.445311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a831f2-e7fe-4116-b317-0e4f1234ae4a None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:20.537273 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 104/199] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 858 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:28:20.545921 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492a8f4-1c25-46d9-8687-ffa362539b75 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:20.693738 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:20.700803 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a831f2-e7fe-4116-b317-0e4f1234ae4a None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:20.708766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492a8f4-1c25-46d9-8687-ffa362539b75 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:20.729369 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:20.751350 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662156a-448a-471a-93f2-7b81c8fe1b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:20.752698 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662156a-448a-471a-93f2-7b81c8fe1b84 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:20.753255 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662156a-448a-471a-93f2-7b81c8fe1b84 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:20.753870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662156a-448a-471a-93f2-7b81c8fe1b84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:20.754912 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662156a-448a-471a-93f2-7b81c8fe1b84 None admin] RBAC: Adding query filter params (role.id=1e3ce9c8b9934a7bb515b39e21fc1d68, scope.project.id=45f63f10100747b9b9eaf0e3e8021980, user.id=a67df8a580e643139ad1366b40106e72) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:20.755586 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662156a-448a-471a-93f2-7b81c8fe1b84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:20.758258 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662156a-448a-471a-93f2-7b81c8fe1b84 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:20.758550 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16922cd8-487d-481c-a01a-d22614da8f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:20.759191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16922cd8-487d-481c-a01a-d22614da8f3a None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:20.759465 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16922cd8-487d-481c-a01a-d22614da8f3a None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:20.759768 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16922cd8-487d-481c-a01a-d22614da8f3a None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:20.761012 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16922cd8-487d-481c-a01a-d22614da8f3a None admin] RBAC: Authorizing `identity:get_project(project_id=45f63f10100747b9b9eaf0e3e8021980)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:20.762710 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16922cd8-487d-481c-a01a-d22614da8f3a None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:20.765551 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 105/200] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:20 2022] GET /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:20.766758 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16922cd8-487d-481c-a01a-d22614da8f3a None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:20.769293 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 96/201] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:28:20 2022] GET /identity/v3/role_assignments?user.id=a67df8a580e643139ad1366b40106e72&scope.project.id=45f63f10100747b9b9eaf0e3e8021980&role.id=1e3ce9c8b9934a7bb515b39e21fc1d68 => generated 259 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:20.779240 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662156a-448a-471a-93f2-7b81c8fe1b84 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:20.954820 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16922cd8-487d-481c-a01a-d22614da8f3a None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:20.961394 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662156a-448a-471a-93f2-7b81c8fe1b84 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:21.009986 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c906db-d848-407f-9804-3cee36211c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:21.010668 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c906db-d848-407f-9804-3cee36211c74 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:21.010954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c906db-d848-407f-9804-3cee36211c74 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:21.011225 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c906db-d848-407f-9804-3cee36211c74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:21.017439 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a03f2-2449-432e-a61e-2261f9710154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:21.018080 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a03f2-2449-432e-a61e-2261f9710154 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:21.018461 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a03f2-2449-432e-a61e-2261f9710154 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:21.018732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a03f2-2449-432e-a61e-2261f9710154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:21.019619 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a03f2-2449-432e-a61e-2261f9710154 None admin] RBAC: Adding query filter params (role.id=fcd9a48e6c4b4c048380a57be435c3dd, scope.project.id=45f63f10100747b9b9eaf0e3e8021980, user.id=a67df8a580e643139ad1366b40106e72) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:21.019941 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a03f2-2449-432e-a61e-2261f9710154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:21.021548 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a03f2-2449-432e-a61e-2261f9710154 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:21.026098 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c906db-d848-407f-9804-3cee36211c74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:21.031355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-c1c906db-d848-407f-9804-3cee36211c74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:28:21.031355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:21.031355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:21.031355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:21.031355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:21.031355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:21.031355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:21.031355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:21.031355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:21.031355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:21.031355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:21.031355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:21.031355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:21.031355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:21.031355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:21.031355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:21.033457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:21.033457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:21.033457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:21.033457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:21.033457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:21.033457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:21.033457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:21.033457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:21.033457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:21.033457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:21.033457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:21.033457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:21.033457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:21.033457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:21.033457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:21.033457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:21.035319 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:21.035319 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:21.035319 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:21.035319 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:21.035319 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:21.035319 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:21.035319 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:21.035319 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:21.035319 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:21.035319 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:21.035319 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:28:21.035319 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:28:21.035319 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 106/202] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:21.049288 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 97/203] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:28:20 2022] GET /identity/v3/role_assignments?user.id=a67df8a580e643139ad1366b40106e72&scope.project.id=45f63f10100747b9b9eaf0e3e8021980&role.id=fcd9a48e6c4b4c048380a57be435c3dd => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:21.055172 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c906db-d848-407f-9804-3cee36211c74 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:21.093614 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:21.226681 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c906db-d848-407f-9804-3cee36211c74 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:21.283650 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab9b12-f23b-417a-aa49-74bfdf95b8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:21.284645 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab9b12-f23b-417a-aa49-74bfdf95b8ad None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:21.284645 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab9b12-f23b-417a-aa49-74bfdf95b8ad None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:21.284891 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab9b12-f23b-417a-aa49-74bfdf95b8ad None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:21.285825 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab9b12-f23b-417a-aa49-74bfdf95b8ad None admin] RBAC: Adding query filter params (name=reader) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:21.286145 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab9b12-f23b-417a-aa49-74bfdf95b8ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:21.287641 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab9b12-f23b-417a-aa49-74bfdf95b8ad None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:21.298891 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 107/204] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:21.309195 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a03f2-2449-432e-a61e-2261f9710154 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:21.423046 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:21.486535 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a03f2-2449-432e-a61e-2261f9710154 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:21.523403 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e57b7-947e-4822-ab55-f1d8d3fb8161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:21.524088 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e57b7-947e-4822-ab55-f1d8d3fb8161 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:21.524369 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e57b7-947e-4822-ab55-f1d8d3fb8161 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:21.524636 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e57b7-947e-4822-ab55-f1d8d3fb8161 None admin] PATH_INFO: `/v3/users/98a48729723448dba253a13398ea07dd` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:21.525918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e57b7-947e-4822-ab55-f1d8d3fb8161 None admin] RBAC: Authorizing `identity:get_user(user_id=98a48729723448dba253a13398ea07dd)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:21.527411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e57b7-947e-4822-ab55-f1d8d3fb8161 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:21.529501 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 98/205] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:21 2022] GET /identity/v3/users/98a48729723448dba253a13398ea07dd => generated 289 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:21.539035 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab9b12-f23b-417a-aa49-74bfdf95b8ad None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:21.669490 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:21.701527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab9b12-f23b-417a-aa49-74bfdf95b8ad None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:21.753050 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd9b0c-a381-4c85-ac0a-8f1db17cbdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:21.753618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd9b0c-a381-4c85-ac0a-8f1db17cbdb6 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:21.753905 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd9b0c-a381-4c85-ac0a-8f1db17cbdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:21.754185 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd9b0c-a381-4c85-ac0a-8f1db17cbdb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:21.850600 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd9b0c-a381-4c85-ac0a-8f1db17cbdb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:21.852171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd9b0c-a381-4c85-ac0a-8f1db17cbdb6 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:21.978974 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:22.006170 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 108/206] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:28:22.017023 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e57b7-947e-4822-ab55-f1d8d3fb8161 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:22.185310 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e57b7-947e-4822-ab55-f1d8d3fb8161 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:22.207448 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:22.240013 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318632bd-a720-4927-a196-d3fb36f30af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:22.240674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318632bd-a720-4927-a196-d3fb36f30af9 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:22.240957 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318632bd-a720-4927-a196-d3fb36f30af9 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:22.241235 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318632bd-a720-4927-a196-d3fb36f30af9 None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:22.248578 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318632bd-a720-4927-a196-d3fb36f30af9 None admin] RBAC: Authorizing `identity:get_project(project_id=7bb022d88d4f49bc889242cf22018981)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:22.250669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318632bd-a720-4927-a196-d3fb36f30af9 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:22.252965 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 99/207] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:22 2022] GET /identity/v3/projects/7bb022d88d4f49bc889242cf22018981 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:22.262262 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd9b0c-a381-4c85-ac0a-8f1db17cbdb6 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:22.412940 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd9b0c-a381-4c85-ac0a-8f1db17cbdb6 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:22.462064 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7bfde-cf1d-40c9-bad4-181644b64868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:22.462687 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7bfde-cf1d-40c9-bad4-181644b64868 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:22.462964 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7bfde-cf1d-40c9-bad4-181644b64868 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:22.463237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7bfde-cf1d-40c9-bad4-181644b64868 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:22.464016 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7bfde-cf1d-40c9-bad4-181644b64868 None admin] RBAC: Adding query filter params (role.id=147cb5e8478b42c0908186e1c2df0e55, scope.project.id=7bb022d88d4f49bc889242cf22018981, user.id=98a48729723448dba253a13398ea07dd) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:22.464329 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7bfde-cf1d-40c9-bad4-181644b64868 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:22.465871 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7bfde-cf1d-40c9-bad4-181644b64868 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:22.472585 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 109/208] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:28:22 2022] GET /identity/v3/role_assignments?user.id=98a48729723448dba253a13398ea07dd&scope.project.id=7bb022d88d4f49bc889242cf22018981&role.id=147cb5e8478b42c0908186e1c2df0e55 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:22.814287 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093344ee-af3a-49f4-bcda-e57fb547e067 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:22.815088 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093344ee-af3a-49f4-bcda-e57fb547e067 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:22.815088 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093344ee-af3a-49f4-bcda-e57fb547e067 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:22.816704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 100/209] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:22.822285 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7628c8-e454-4c3c-8eed-808f08feb125 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:22.822651 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7628c8-e454-4c3c-8eed-808f08feb125 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:22.822880 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7628c8-e454-4c3c-8eed-808f08feb125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:22.852810 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-dd7628c8-e454-4c3c-8eed-808f08feb125 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:22.854173 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-dd7628c8-e454-4c3c-8eed-808f08feb125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:22.910994 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:22.950044 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 110/210] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:22.992361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74b9d3-8bcd-4d5b-bc98-242c9c1ec90d None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:22.992764 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74b9d3-8bcd-4d5b-bc98-242c9c1ec90d None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:22.992935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74b9d3-8bcd-4d5b-bc98-242c9c1ec90d None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:22.994699 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 101/211] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:23.003507 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09de24-00dd-4109-b8eb-212fe554178b None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:23.008280 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09de24-00dd-4109-b8eb-212fe554178b None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:23.008280 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09de24-00dd-4109-b8eb-212fe554178b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:23.043456 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-da09de24-00dd-4109-b8eb-212fe554178b None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:23.048013 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-da09de24-00dd-4109-b8eb-212fe554178b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:23.143436 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 111/212] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:28:23.351142 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74b9d3-8bcd-4d5b-bc98-242c9c1ec90d None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:23.522597 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74b9d3-8bcd-4d5b-bc98-242c9c1ec90d None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:23.595105 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0972bc-afc2-45b9-a70d-adb65189fc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:23.596388 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0972bc-afc2-45b9-a70d-adb65189fc10 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:23.596900 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0972bc-afc2-45b9-a70d-adb65189fc10 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:23.597399 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0972bc-afc2-45b9-a70d-adb65189fc10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:23.619234 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0972bc-afc2-45b9-a70d-adb65189fc10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:23.630782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-cf0972bc-afc2-45b9-a70d-adb65189fc10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:23.630782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:23.630782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:23.630782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:23.630782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:23.630782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:23.630782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:23.630782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:23.630782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:23.630782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:23.630782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:23.630782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:23.630782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:23.630782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:23.630782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:23.630782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:23.631773 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:23.631773 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:23.631773 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:23.631773 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:23.631773 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:23.631773 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:23.631773 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:23.631773 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:23.631773 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:23.631773 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:23.631773 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:23.631773 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:23.631773 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:23.631773 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:23.631773 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:23.631773 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:23.632567 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:23.632567 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:23.632567 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:23.632567 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:23.632567 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:23.632567 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:23.632567 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:23.632567 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:23.632567 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:23.632567 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:23.632567 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:23.632567 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:23.633189 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 102/213] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:23.644037 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09de24-00dd-4109-b8eb-212fe554178b None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:23.773505 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09de24-00dd-4109-b8eb-212fe554178b None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:23.776632 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:23.787586 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0972bc-afc2-45b9-a70d-adb65189fc10 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:23.815975 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d870ef-a472-43fd-869c-326a678d296e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:23.816609 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d870ef-a472-43fd-869c-326a678d296e None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:23.816893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d870ef-a472-43fd-869c-326a678d296e None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:23.817167 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d870ef-a472-43fd-869c-326a678d296e None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:23.817860 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d870ef-a472-43fd-869c-326a678d296e None admin] RBAC: Adding query filter params (name=member) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:23.818414 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d870ef-a472-43fd-869c-326a678d296e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:23.819922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d870ef-a472-43fd-869c-326a678d296e None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:23.830881 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 112/214] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:23.841144 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d870ef-a472-43fd-869c-326a678d296e None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:23.864765 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:23.976903 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0972bc-afc2-45b9-a70d-adb65189fc10 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:23.985965 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d870ef-a472-43fd-869c-326a678d296e None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:24.028380 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a2aae-d192-4bdc-80d8-dba2fbecb461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:24.028917 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a2aae-d192-4bdc-80d8-dba2fbecb461 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:24.029245 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a2aae-d192-4bdc-80d8-dba2fbecb461 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:24.029581 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a2aae-d192-4bdc-80d8-dba2fbecb461 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:24.030673 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a2aae-d192-4bdc-80d8-dba2fbecb461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:24.030835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb46625-36d8-437f-94b2-a151382457aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:24.031389 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb46625-36d8-437f-94b2-a151382457aa None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:24.031712 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb46625-36d8-437f-94b2-a151382457aa None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:24.032047 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb46625-36d8-437f-94b2-a151382457aa None admin] PATH_INFO: `/v3/users/7dd7e4f0eebc45109a645be5cf1c41cf` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:24.032326 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a2aae-d192-4bdc-80d8-dba2fbecb461 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:24.035600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 103/215] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:28:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:24.035600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32dd1a-b993-4783-a0a2-c66c896be768 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:24.035600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32dd1a-b993-4783-a0a2-c66c896be768 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:24.035906 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32dd1a-b993-4783-a0a2-c66c896be768 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:24.036977 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 104/216] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:24.042358 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462d852-8a76-4bea-b8a6-7654a0b1e59b None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:24.042644 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462d852-8a76-4bea-b8a6-7654a0b1e59b None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:24.042919 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462d852-8a76-4bea-b8a6-7654a0b1e59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:24.055877 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb46625-36d8-437f-94b2-a151382457aa None admin] RBAC: Authorizing `identity:get_user(user_id=7dd7e4f0eebc45109a645be5cf1c41cf)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:24.057400 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb46625-36d8-437f-94b2-a151382457aa None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:24.066932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 113/217] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:23 2022] GET /identity/v3/users/7dd7e4f0eebc45109a645be5cf1c41cf => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:24.066932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb46625-36d8-437f-94b2-a151382457aa None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:24.072085 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-6462d852-8a76-4bea-b8a6-7654a0b1e59b None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:24.073311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-6462d852-8a76-4bea-b8a6-7654a0b1e59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:24.097890 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:24.164573 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 105/218] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:28:24.166472 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462d852-8a76-4bea-b8a6-7654a0b1e59b None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:24.234235 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb46625-36d8-437f-94b2-a151382457aa None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:24.243684 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:24.297147 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785eb8c-92ff-4e26-8a50-0293fabb3917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:24.297765 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785eb8c-92ff-4e26-8a50-0293fabb3917 None admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:24.298043 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785eb8c-92ff-4e26-8a50-0293fabb3917 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:24.298316 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785eb8c-92ff-4e26-8a50-0293fabb3917 None admin] PATH_INFO: `/v3/users` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:24.298997 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785eb8c-92ff-4e26-8a50-0293fabb3917 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:24.300500 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785eb8c-92ff-4e26-8a50-0293fabb3917 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:24.336826 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462d852-8a76-4bea-b8a6-7654a0b1e59b None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:24.382180 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e88027-01fb-4b21-97ae-c0970b3e537a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:24.383001 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e88027-01fb-4b21-97ae-c0970b3e537a None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:24.383400 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e88027-01fb-4b21-97ae-c0970b3e537a None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:24.383845 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e88027-01fb-4b21-97ae-c0970b3e537a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:24.436240 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 114/219] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 20:28:24 2022] POST /identity/v3/users => generated 297 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:28:24.446297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cc3a1-f6f5-4e76-b737-9f0ee1e79292 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:24.446755 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cc3a1-f6f5-4e76-b737-9f0ee1e79292 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:24.447245 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cc3a1-f6f5-4e76-b737-9f0ee1e79292 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:24.451178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 115/220] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:24.460729 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc34e8f-2513-47bb-9dc4-fc96eea19a72 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:24.461185 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc34e8f-2513-47bb-9dc4-fc96eea19a72 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:24.461643 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc34e8f-2513-47bb-9dc4-fc96eea19a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:24.486559 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e88027-01fb-4b21-97ae-c0970b3e537a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:24.489736 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e88027-01fb-4b21-97ae-c0970b3e537a None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:24.501165 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-2cc34e8f-2513-47bb-9dc4-fc96eea19a72 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:24.503136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-2cc34e8f-2513-47bb-9dc4-fc96eea19a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:24.579511 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:24.622990 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 116/221] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:28:24.623920 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc34e8f-2513-47bb-9dc4-fc96eea19a72 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:24.646056 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:24.677378 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 106/222] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:28:24.687262 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e88027-01fb-4b21-97ae-c0970b3e537a None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:24.818567 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc34e8f-2513-47bb-9dc4-fc96eea19a72 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:24.861927 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de459836-1c93-4453-ba33-93b7cde5ac00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:24.862803 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de459836-1c93-4453-ba33-93b7cde5ac00 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:24.863072 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de459836-1c93-4453-ba33-93b7cde5ac00 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:24.863351 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de459836-1c93-4453-ba33-93b7cde5ac00 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:24.865819 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e88027-01fb-4b21-97ae-c0970b3e537a None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:24.886943 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de459836-1c93-4453-ba33-93b7cde5ac00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:24.891532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-de459836-1c93-4453-ba33-93b7cde5ac00 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:28:24.891532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:24.891532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:24.891532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:24.891532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:24.891532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:24.891532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:24.891532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:24.891532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:24.891532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:24.891532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:24.891532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:24.891532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:24.891532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:24.891532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:24.891532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:24.893410 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:24.893410 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:24.893410 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:24.893410 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:24.893410 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:24.893410 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:24.893410 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:24.893410 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:24.893410 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:24.893410 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:24.893410 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:24.893410 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:24.893410 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:24.893410 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:24.893410 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:24.893410 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:24.895796 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:24.895796 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:24.895796 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:24.895796 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:24.895796 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:24.895796 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:24.895796 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:24.895796 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:24.895796 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:24.895796 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:24.895796 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:28:24.895796 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:28:24.895796 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 117/223] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 20:28:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:24.900631 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de459836-1c93-4453-ba33-93b7cde5ac00 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:24.955885 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad830ea-a7c7-43dc-b456-e22cea050923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:24.956593 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad830ea-a7c7-43dc-b456-e22cea050923 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:24.956876 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad830ea-a7c7-43dc-b456-e22cea050923 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:24.957354 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad830ea-a7c7-43dc-b456-e22cea050923 None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:24.958844 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad830ea-a7c7-43dc-b456-e22cea050923 None admin] RBAC: Authorizing `identity:get_project(project_id=45f63f10100747b9b9eaf0e3e8021980)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:24.960870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad830ea-a7c7-43dc-b456-e22cea050923 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:24.963629 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 107/224] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:24 2022] GET /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:24.975423 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad830ea-a7c7-43dc-b456-e22cea050923 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:24.989158 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:25.054975 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:25.126491 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de459836-1c93-4453-ba33-93b7cde5ac00 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:25.169788 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad830ea-a7c7-43dc-b456-e22cea050923 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:25.194875 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c57e1-b366-4153-8c5f-c668e7de8e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:25.196074 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c57e1-b366-4153-8c5f-c668e7de8e06 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:25.196597 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c57e1-b366-4153-8c5f-c668e7de8e06 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:25.197111 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c57e1-b366-4153-8c5f-c668e7de8e06 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:25.198524 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c57e1-b366-4153-8c5f-c668e7de8e06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:25.199191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c57e1-b366-4153-8c5f-c668e7de8e06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:25.202128 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c57e1-b366-4153-8c5f-c668e7de8e06 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:25.220837 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 118/225] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:28:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:25.227671 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c57e1-b366-4153-8c5f-c668e7de8e06 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:25.299877 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f522e-4fac-4a47-a85a-b016337172a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:25.303257 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f522e-4fac-4a47-a85a-b016337172a4 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:25.305742 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f522e-4fac-4a47-a85a-b016337172a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:25.306218 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f522e-4fac-4a47-a85a-b016337172a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:25.307709 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f522e-4fac-4a47-a85a-b016337172a4 None admin] RBAC: Adding query filter params (role.id=910e8004690649e3b4fc1c4be76ad967, scope.project.id=45f63f10100747b9b9eaf0e3e8021980, user.id=7dd7e4f0eebc45109a645be5cf1c41cf) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:25.308540 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f522e-4fac-4a47-a85a-b016337172a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:25.315106 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f522e-4fac-4a47-a85a-b016337172a4 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:25.334015 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 108/226] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:28:24 2022] GET /identity/v3/role_assignments?user.id=7dd7e4f0eebc45109a645be5cf1c41cf&scope.project.id=45f63f10100747b9b9eaf0e3e8021980&role.id=910e8004690649e3b4fc1c4be76ad967 => generated 259 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:25.373614 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f522e-4fac-4a47-a85a-b016337172a4 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:25.515535 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c57e1-b366-4153-8c5f-c668e7de8e06 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:25.584305 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:25.586953 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:25.592534 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7472ed-a026-4550-93c6-3c15d41f00f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:25.604045 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7472ed-a026-4550-93c6-3c15d41f00f9 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:25.604045 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7472ed-a026-4550-93c6-3c15d41f00f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:25.604045 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7472ed-a026-4550-93c6-3c15d41f00f9 None admin] PATH_INFO: `/v3/users/a67df8a580e643139ad1366b40106e72` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:25.604045 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7472ed-a026-4550-93c6-3c15d41f00f9 None admin] RBAC: Authorizing `identity:get_user(user_id=a67df8a580e643139ad1366b40106e72)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:25.604045 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7472ed-a026-4550-93c6-3c15d41f00f9 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:25.604045 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 119/227] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:25 2022] GET /identity/v3/users/a67df8a580e643139ad1366b40106e72 => generated 283 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:25.611385 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7472ed-a026-4550-93c6-3c15d41f00f9 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:25.690968 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f522e-4fac-4a47-a85a-b016337172a4 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:25.757421 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec3a06-f54d-4017-baa2-8021c728e6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:25.758584 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec3a06-f54d-4017-baa2-8021c728e6ff None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:25.759094 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec3a06-f54d-4017-baa2-8021c728e6ff None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:25.759599 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec3a06-f54d-4017-baa2-8021c728e6ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:25.791006 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec3a06-f54d-4017-baa2-8021c728e6ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:25.797039 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-20ec3a06-f54d-4017-baa2-8021c728e6ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:25.797039 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:25.797039 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:25.797039 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:25.797039 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:25.797039 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:25.797039 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:25.797039 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:25.797039 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:25.797039 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:25.797039 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:25.797039 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:25.797039 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:25.797039 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:25.797039 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:25.797039 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:25.797991 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:25.797991 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:25.797991 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:25.797991 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:25.797991 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:25.797991 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:25.797991 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:25.797991 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:25.797991 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:25.797991 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:25.797991 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:25.797991 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:25.797991 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:25.797991 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:25.797991 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:25.797991 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:25.798784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:25.798784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:25.798784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:25.798784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:25.798784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:25.798784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:25.798784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:25.798784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:25.798784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:25.798784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:25.798784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:25.798784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:25.808032 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 109/228] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 20:28:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:25.832299 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec3a06-f54d-4017-baa2-8021c728e6ff None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:25.844181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7472ed-a026-4550-93c6-3c15d41f00f9 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:25.907427 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3627f88-d44e-40d2-9f88-121c2cd7d314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:25.908659 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3627f88-d44e-40d2-9f88-121c2cd7d314 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:25.909201 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3627f88-d44e-40d2-9f88-121c2cd7d314 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:25.909733 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3627f88-d44e-40d2-9f88-121c2cd7d314 None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:25.911909 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3627f88-d44e-40d2-9f88-121c2cd7d314 None admin] RBAC: Authorizing `identity:get_project(project_id=45f63f10100747b9b9eaf0e3e8021980)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:25.914872 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3627f88-d44e-40d2-9f88-121c2cd7d314 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:25.918931 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 120/229] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:25 2022] GET /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980 => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:25.925705 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3627f88-d44e-40d2-9f88-121c2cd7d314 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:26.143066 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec3a06-f54d-4017-baa2-8021c728e6ff None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:26.170880 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:26.208339 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:26.220211 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e4415-b3bf-44bd-af1a-20c23788df28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:26.222094 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e4415-b3bf-44bd-af1a-20c23788df28 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:26.222891 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e4415-b3bf-44bd-af1a-20c23788df28 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:26.223634 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e4415-b3bf-44bd-af1a-20c23788df28 None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:26.225307 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e4415-b3bf-44bd-af1a-20c23788df28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:26.226137 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e4415-b3bf-44bd-af1a-20c23788df28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:26.229119 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e4415-b3bf-44bd-af1a-20c23788df28 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:26.251881 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 110/230] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:26.264154 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e4415-b3bf-44bd-af1a-20c23788df28 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:26.293427 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3627f88-d44e-40d2-9f88-121c2cd7d314 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:26.420165 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616f934-233b-4e73-9e1c-16da63518b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:26.420917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616f934-233b-4e73-9e1c-16da63518b66 None admin] REQUEST_METHOD: `PUT` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:26.424301 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616f934-233b-4e73-9e1c-16da63518b66 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:26.424632 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616f934-233b-4e73-9e1c-16da63518b66 None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980/users/a67df8a580e643139ad1366b40106e72/roles/fcd9a48e6c4b4c048380a57be435c3dd` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:26.433775 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616f934-233b-4e73-9e1c-16da63518b66 None admin] RBAC: Authorizing `identity:create_grant(project_id=45f63f10100747b9b9eaf0e3e8021980, user_id=a67df8a580e643139ad1366b40106e72, role_id=fcd9a48e6c4b4c048380a57be435c3dd)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:26.438283 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616f934-233b-4e73-9e1c-16da63518b66 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:26.499984 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e4415-b3bf-44bd-af1a-20c23788df28 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:26.528129 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 121/231] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 20:28:25 2022] PUT /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980/users/a67df8a580e643139ad1366b40106e72/roles/fcd9a48e6c4b4c048380a57be435c3dd => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:28:26.538841 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1434023-1bc4-45bc-a03d-f5d378286096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:26.539568 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1434023-1bc4-45bc-a03d-f5d378286096 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:26.539859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1434023-1bc4-45bc-a03d-f5d378286096 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:26.540135 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1434023-1bc4-45bc-a03d-f5d378286096 None admin] PATH_INFO: `/v3/users/a67df8a580e643139ad1366b40106e72` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:26.542235 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1434023-1bc4-45bc-a03d-f5d378286096 None admin] RBAC: Authorizing `identity:get_user(user_id=a67df8a580e643139ad1366b40106e72)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:26.543970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1434023-1bc4-45bc-a03d-f5d378286096 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:26.546916 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 111/232] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:26 2022] GET /identity/v3/users/a67df8a580e643139ad1366b40106e72 => generated 283 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:26.568113 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616f934-233b-4e73-9e1c-16da63518b66 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:26.751967 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616f934-233b-4e73-9e1c-16da63518b66 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:26.797656 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:26.810340 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75394f7f-4e45-45cd-b468-6c151e26191e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:26.811006 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75394f7f-4e45-45cd-b468-6c151e26191e None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:26.826406 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75394f7f-4e45-45cd-b468-6c151e26191e None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:26.826406 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75394f7f-4e45-45cd-b468-6c151e26191e None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:26.826406 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75394f7f-4e45-45cd-b468-6c151e26191e None admin] RBAC: Authorizing `identity:get_project(project_id=45f63f10100747b9b9eaf0e3e8021980)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:26.826406 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75394f7f-4e45-45cd-b468-6c151e26191e None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:26.826406 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 122/233] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:26 2022] GET /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:26.826789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1434023-1bc4-45bc-a03d-f5d378286096 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:26.911914 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:26.959459 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1434023-1bc4-45bc-a03d-f5d378286096 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:27.006032 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514933ab-a3fa-40ab-9c08-126aa6fa0164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:27.006648 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514933ab-a3fa-40ab-9c08-126aa6fa0164 None admin] REQUEST_METHOD: `PUT` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:27.006929 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514933ab-a3fa-40ab-9c08-126aa6fa0164 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:27.007203 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514933ab-a3fa-40ab-9c08-126aa6fa0164 None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980/users/a67df8a580e643139ad1366b40106e72/roles/1e3ce9c8b9934a7bb515b39e21fc1d68` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:27.009347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514933ab-a3fa-40ab-9c08-126aa6fa0164 None admin] RBAC: Authorizing `identity:create_grant(project_id=45f63f10100747b9b9eaf0e3e8021980, user_id=a67df8a580e643139ad1366b40106e72, role_id=1e3ce9c8b9934a7bb515b39e21fc1d68)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:27.010842 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514933ab-a3fa-40ab-9c08-126aa6fa0164 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:27.131248 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 112/234] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 20:28:26 2022] PUT /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980/users/a67df8a580e643139ad1366b40106e72/roles/1e3ce9c8b9934a7bb515b39e21fc1d68 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:28:28.044145 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df42cd-70fc-4e82-99a4-6d9ab07aec52 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:28.044671 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df42cd-70fc-4e82-99a4-6d9ab07aec52 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:28.044671 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df42cd-70fc-4e82-99a4-6d9ab07aec52 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:28.046884 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 123/235] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:28.052498 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e85363-31bf-4d84-8d35-8dd0c2b5df2d None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:28.053438 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e85363-31bf-4d84-8d35-8dd0c2b5df2d None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:28.053929 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e85363-31bf-4d84-8d35-8dd0c2b5df2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:28.068907 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce242a5-e079-4636-9244-87d1c1179bce None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:28.069162 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce242a5-e079-4636-9244-87d1c1179bce None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:28.069461 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce242a5-e079-4636-9244-87d1c1179bce None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:28.071064 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 124/236] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:28:28.078399 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-e9e85363-31bf-4d84-8d35-8dd0c2b5df2d None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:28.079504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-e9e85363-31bf-4d84-8d35-8dd0c2b5df2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:28.081444 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d97e4-3dc0-4757-97d5-503b9ece760e None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:28.082208 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d97e4-3dc0-4757-97d5-503b9ece760e None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:28.082973 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d97e4-3dc0-4757-97d5-503b9ece760e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:28.126647 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-059d97e4-3dc0-4757-97d5-503b9ece760e None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:28.129311 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-059d97e4-3dc0-4757-97d5-503b9ece760e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:28.200554 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 113/237] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:28.312029 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 125/238] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:28:28.821804 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e85363-31bf-4d84-8d35-8dd0c2b5df2d None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:28.924483 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220932d7-2bc2-4161-9b73-270755105b8a None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:28.926076 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220932d7-2bc2-4161-9b73-270755105b8a None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:28.927448 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220932d7-2bc2-4161-9b73-270755105b8a None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:28.932226 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 126/239] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:28 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:28.938434 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:28.953175 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b3a09-e292-4b45-8bb0-2206367744bf None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:28.953955 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b3a09-e292-4b45-8bb0-2206367744bf None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:28.954320 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b3a09-e292-4b45-8bb0-2206367744bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:28.996382 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e85363-31bf-4d84-8d35-8dd0c2b5df2d None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:29.013425 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-9c8b3a09-e292-4b45-8bb0-2206367744bf None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:29.036376 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-9c8b3a09-e292-4b45-8bb0-2206367744bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:29.066256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b61bf-0849-470b-a353-c089752bb2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:29.067571 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b61bf-0849-470b-a353-c089752bb2e7 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:29.068029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b61bf-0849-470b-a353-c089752bb2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:29.068499 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b61bf-0849-470b-a353-c089752bb2e7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:29.082204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b61bf-0849-470b-a353-c089752bb2e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:29.088266 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-700b61bf-0849-470b-a353-c089752bb2e7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:28:29.088266 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:29.088266 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:29.088266 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:29.088266 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:29.088266 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:29.088266 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:29.088266 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:29.088266 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:29.088266 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:29.088266 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:29.088266 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:29.088266 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:29.088266 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:29.088266 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:29.088266 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:29.089183 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:29.089183 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:29.089183 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:29.089183 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:29.089183 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:29.089183 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:29.089183 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:29.089183 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:29.089183 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:29.089183 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:29.089183 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:29.089183 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:29.089183 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:29.089183 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:29.089183 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:29.089183 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:29.089952 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:29.089952 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:29.089952 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:29.089952 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:29.089952 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:29.089952 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:29.089952 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:29.089952 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:29.089952 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:29.089952 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:29.089952 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:28:29.089952 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:29.092714 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 114/240] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:29.098866 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b61bf-0849-470b-a353-c089752bb2e7 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:29.157792 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 127/241] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:29.159342 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b3a09-e292-4b45-8bb0-2206367744bf None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:29.293469 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:29.352739 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b61bf-0849-470b-a353-c089752bb2e7 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:29.376585 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:29.414445 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b3a09-e292-4b45-8bb0-2206367744bf None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:29.443434 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b5868-35d2-4377-8910-b79d0391cf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:29.444233 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b5868-35d2-4377-8910-b79d0391cf80 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:29.444511 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b5868-35d2-4377-8910-b79d0391cf80 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:29.444783 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b5868-35d2-4377-8910-b79d0391cf80 None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:29.445493 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b5868-35d2-4377-8910-b79d0391cf80 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:29.445796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b5868-35d2-4377-8910-b79d0391cf80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:29.447272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b5868-35d2-4377-8910-b79d0391cf80 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:29.469176 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 115/242] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:29.475677 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b5868-35d2-4377-8910-b79d0391cf80 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:29.500352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71ee4d-4bdb-4902-a2d7-cca25e3ba7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:29.501020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71ee4d-4bdb-4902-a2d7-cca25e3ba7e2 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:29.501296 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71ee4d-4bdb-4902-a2d7-cca25e3ba7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:29.501568 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71ee4d-4bdb-4902-a2d7-cca25e3ba7e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:29.502862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71ee4d-4bdb-4902-a2d7-cca25e3ba7e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:29.504425 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71ee4d-4bdb-4902-a2d7-cca25e3ba7e2 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:29.506172 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 128/243] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:28:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:29.514213 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71ee4d-4bdb-4902-a2d7-cca25e3ba7e2 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:29.766351 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b5868-35d2-4377-8910-b79d0391cf80 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:29.775778 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71ee4d-4bdb-4902-a2d7-cca25e3ba7e2 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:29.806205 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:29.819452 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e151b-56c7-4467-951f-54ce9ddb870b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:29.820123 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e151b-56c7-4467-951f-54ce9ddb870b None admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:29.820403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e151b-56c7-4467-951f-54ce9ddb870b None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:29.820676 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e151b-56c7-4467-951f-54ce9ddb870b None admin] PATH_INFO: `/v3/users` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:29.823599 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e151b-56c7-4467-951f-54ce9ddb870b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:29.823599 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e151b-56c7-4467-951f-54ce9ddb870b None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:29.823862 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f833b-43a7-4b13-83f6-f7142e0e08d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:29.824321 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f833b-43a7-4b13-83f6-f7142e0e08d4 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:29.824862 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f833b-43a7-4b13-83f6-f7142e0e08d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:29.825289 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f833b-43a7-4b13-83f6-f7142e0e08d4 None admin] PATH_INFO: `/v3/users/c89c346d98fc47198bce08a178905738` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:29.851989 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f833b-43a7-4b13-83f6-f7142e0e08d4 None admin] RBAC: Authorizing `identity:get_user(user_id=c89c346d98fc47198bce08a178905738)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:29.853987 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f833b-43a7-4b13-83f6-f7142e0e08d4 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:29.855912 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 116/244] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:29 2022] GET /identity/v3/users/c89c346d98fc47198bce08a178905738 => generated 297 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:29.857555 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dc76c-cf9f-4196-9fb4-af1ec409da81 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:29.857998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dc76c-cf9f-4196-9fb4-af1ec409da81 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:29.858428 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dc76c-cf9f-4196-9fb4-af1ec409da81 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:29.860146 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 117/245] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:29.861278 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243dc76c-cf9f-4196-9fb4-af1ec409da81 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:29.895526 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:29.914921 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 129/246] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 20:28:29 2022] POST /identity/v3/users => generated 293 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:28:29.916166 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e151b-56c7-4467-951f-54ce9ddb870b None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:30.012278 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243dc76c-cf9f-4196-9fb4-af1ec409da81 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:30.080959 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb00434-f125-4311-89c7-7ddf5f64f0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:30.081987 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb00434-f125-4311-89c7-7ddf5f64f0eb None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:30.082158 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb00434-f125-4311-89c7-7ddf5f64f0eb None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:30.082614 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb00434-f125-4311-89c7-7ddf5f64f0eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:30.100037 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb00434-f125-4311-89c7-7ddf5f64f0eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:30.107095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-0cb00434-f125-4311-89c7-7ddf5f64f0eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:30.107095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:30.107095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:30.107095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:30.107095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:30.107095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:30.107095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:30.107095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:30.107095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:30.107095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:30.107095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:30.107095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:30.107095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:30.107095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:30.107095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:30.107095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:30.109332 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:30.109332 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:30.109332 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:30.109332 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:30.109332 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:30.109332 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:30.109332 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:30.109332 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:30.109332 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:30.109332 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:30.109332 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:30.109332 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:30.109332 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:30.109332 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:30.109332 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:30.109332 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:30.111533 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:30.111533 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:30.111533 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:30.111533 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:30.111533 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:30.111533 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:30.111533 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:30.111533 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:30.111533 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:30.111533 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:30.111533 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:30.111533 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:30.111533 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 118/247] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:30.112616 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63eb70-92ed-4dc8-92fb-f13320e8b6a5 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:30.112616 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63eb70-92ed-4dc8-92fb-f13320e8b6a5 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:30.113258 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63eb70-92ed-4dc8-92fb-f13320e8b6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:30.147351 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-6e63eb70-92ed-4dc8-92fb-f13320e8b6a5 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:30.148635 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e151b-56c7-4467-951f-54ce9ddb870b None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:30.149492 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-6e63eb70-92ed-4dc8-92fb-f13320e8b6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:30.217440 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3debd-5822-494d-8b6b-e813e7bfbb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:30.218494 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3debd-5822-494d-8b6b-e813e7bfbb4a None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:30.218991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3debd-5822-494d-8b6b-e813e7bfbb4a None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:30.219481 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3debd-5822-494d-8b6b-e813e7bfbb4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:30.269076 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 119/248] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:30.275537 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63eb70-92ed-4dc8-92fb-f13320e8b6a5 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:30.321023 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:30.323100 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:30.365397 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3debd-5822-494d-8b6b-e813e7bfbb4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:30.367271 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3debd-5822-494d-8b6b-e813e7bfbb4a None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:30.490853 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63eb70-92ed-4dc8-92fb-f13320e8b6a5 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:30.503587 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 130/249] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:28:30.518414 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3debd-5822-494d-8b6b-e813e7bfbb4a None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:30.555078 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c19d6-5dab-41b7-997f-f842d9ba5689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:30.555891 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c19d6-5dab-41b7-997f-f842d9ba5689 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:30.556810 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c19d6-5dab-41b7-997f-f842d9ba5689 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:30.557226 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c19d6-5dab-41b7-997f-f842d9ba5689 None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:30.558043 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c19d6-5dab-41b7-997f-f842d9ba5689 None admin] RBAC: Adding query filter params (name=member) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:30.558708 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c19d6-5dab-41b7-997f-f842d9ba5689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:30.560291 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c19d6-5dab-41b7-997f-f842d9ba5689 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:30.573138 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 120/250] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:30.579823 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c19d6-5dab-41b7-997f-f842d9ba5689 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:30.712216 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c19d6-5dab-41b7-997f-f842d9ba5689 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:30.715992 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:30.724156 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:30.759618 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1d8ba-baa7-46a2-a124-64ae54b95be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:30.760297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1d8ba-baa7-46a2-a124-64ae54b95be1 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:30.760578 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1d8ba-baa7-46a2-a124-64ae54b95be1 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:30.760854 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1d8ba-baa7-46a2-a124-64ae54b95be1 None admin] PATH_INFO: `/v3/users/7dd7e4f0eebc45109a645be5cf1c41cf` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:30.762229 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1d8ba-baa7-46a2-a124-64ae54b95be1 None admin] RBAC: Authorizing `identity:get_user(user_id=7dd7e4f0eebc45109a645be5cf1c41cf)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:30.763906 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1d8ba-baa7-46a2-a124-64ae54b95be1 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:30.764665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3debd-5822-494d-8b6b-e813e7bfbb4a None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:30.766424 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 121/251] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:30 2022] GET /identity/v3/users/7dd7e4f0eebc45109a645be5cf1c41cf => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:30.767015 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1d8ba-baa7-46a2-a124-64ae54b95be1 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:30.831181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386e290-a66b-4b8b-8779-e866c0127018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:30.831898 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386e290-a66b-4b8b-8779-e866c0127018 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:30.832179 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386e290-a66b-4b8b-8779-e866c0127018 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:30.832451 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386e290-a66b-4b8b-8779-e866c0127018 None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:30.833712 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386e290-a66b-4b8b-8779-e866c0127018 None admin] RBAC: Authorizing `identity:get_project(project_id=45f63f10100747b9b9eaf0e3e8021980)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:30.835787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386e290-a66b-4b8b-8779-e866c0127018 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:30.837882 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 131/252] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:30 2022] GET /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980 => generated 302 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:30.843582 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386e290-a66b-4b8b-8779-e866c0127018 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:30.935799 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1d8ba-baa7-46a2-a124-64ae54b95be1 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:30.977098 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3dab61-a80e-484b-ab72-5b4bee0bfd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:30.977653 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dab61-a80e-484b-ab72-5b4bee0bfd5e None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:30.977934 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dab61-a80e-484b-ab72-5b4bee0bfd5e None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:30.978210 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dab61-a80e-484b-ab72-5b4bee0bfd5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:30.991468 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3dab61-a80e-484b-ab72-5b4bee0bfd5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:30.996933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-9b3dab61-a80e-484b-ab72-5b4bee0bfd5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:28:30.996933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:30.996933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:30.996933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:30.996933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:30.996933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:30.996933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:30.996933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:30.996933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:30.996933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:30.996933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:30.996933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:30.996933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:30.996933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:30.996933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:30.996933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:30.998674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:30.998674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:30.998674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:30.998674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:30.998674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:30.998674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:30.998674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:30.998674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:30.998674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:30.998674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:30.998674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:30.998674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:30.998674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:30.998674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:30.998674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:30.998674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:31.000848 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:31.000848 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:31.000848 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:31.000848 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:31.000848 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:31.000848 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:31.000848 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:31.000848 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:31.000848 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:31.000848 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:31.000848 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:28:31.000848 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:31.000848 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 122/253] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 20:28:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:31.005040 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fcb23-6768-418a-9473-38b66e5d0a3a None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:31.005358 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fcb23-6768-418a-9473-38b66e5d0a3a None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:31.005609 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fcb23-6768-418a-9473-38b66e5d0a3a None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:31.007301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 123/254] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:31.007950 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fcb23-6768-418a-9473-38b66e5d0a3a None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:31.026972 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:31.053564 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386e290-a66b-4b8b-8779-e866c0127018 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:31.119089 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213544e-1083-400a-ba89-d26817043c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:31.120745 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213544e-1083-400a-ba89-d26817043c9e None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:31.121536 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213544e-1083-400a-ba89-d26817043c9e None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:31.122294 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213544e-1083-400a-ba89-d26817043c9e None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:31.124801 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213544e-1083-400a-ba89-d26817043c9e None admin] RBAC: Authorizing `identity:get_project(project_id=45f63f10100747b9b9eaf0e3e8021980)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:31.128120 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213544e-1083-400a-ba89-d26817043c9e None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:31.131823 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 132/255] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:30 2022] GET /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:31.133094 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fcb23-6768-418a-9473-38b66e5d0a3a None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:31.135409 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090328f-eea2-43eb-9660-b6cc3b0c6366 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:31.136271 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090328f-eea2-43eb-9660-b6cc3b0c6366 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:31.137048 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090328f-eea2-43eb-9660-b6cc3b0c6366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:31.170149 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-c090328f-eea2-43eb-9660-b6cc3b0c6366 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:31.173352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-c090328f-eea2-43eb-9660-b6cc3b0c6366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:31.173774 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa11082-7e85-465e-99c0-572605361d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:31.174402 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa11082-7e85-465e-99c0-572605361d4d None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:31.174681 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa11082-7e85-465e-99c0-572605361d4d None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:31.174948 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa11082-7e85-465e-99c0-572605361d4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:31.175735 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa11082-7e85-465e-99c0-572605361d4d None admin] RBAC: Adding query filter params (role.id=147cb5e8478b42c0908186e1c2df0e55, scope.project.id=45f63f10100747b9b9eaf0e3e8021980, user.id=c89c346d98fc47198bce08a178905738) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:31.176044 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa11082-7e85-465e-99c0-572605361d4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:31.177524 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa11082-7e85-465e-99c0-572605361d4d None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:31.191583 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 124/256] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:28:31 2022] GET /identity/v3/role_assignments?user.id=c89c346d98fc47198bce08a178905738&scope.project.id=45f63f10100747b9b9eaf0e3e8021980&role.id=147cb5e8478b42c0908186e1c2df0e55 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:31.191583 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa11082-7e85-465e-99c0-572605361d4d None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:31.214315 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:31.279090 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:31.310975 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa11082-7e85-465e-99c0-572605361d4d None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:31.353030 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da563ae-5068-4d40-ad59-3bb03ea25794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:31.353663 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da563ae-5068-4d40-ad59-3bb03ea25794 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:31.353942 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da563ae-5068-4d40-ad59-3bb03ea25794 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:31.354214 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da563ae-5068-4d40-ad59-3bb03ea25794 None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:31.354906 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da563ae-5068-4d40-ad59-3bb03ea25794 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:31.355331 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da563ae-5068-4d40-ad59-3bb03ea25794 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:31.356926 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da563ae-5068-4d40-ad59-3bb03ea25794 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:31.366274 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 133/257] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:31.366954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090328f-eea2-43eb-9660-b6cc3b0c6366 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:31.375265 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 125/258] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:28:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:31.384935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da563ae-5068-4d40-ad59-3bb03ea25794 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:31.569883 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090328f-eea2-43eb-9660-b6cc3b0c6366 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:31.609832 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da563ae-5068-4d40-ad59-3bb03ea25794 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:31.616949 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b30d1b-a6ab-49f3-9616-b48462679e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:31.617641 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b30d1b-a6ab-49f3-9616-b48462679e84 None admin] REQUEST_METHOD: `PUT` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:31.617954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b30d1b-a6ab-49f3-9616-b48462679e84 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:31.618211 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b30d1b-a6ab-49f3-9616-b48462679e84 None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980/users/7dd7e4f0eebc45109a645be5cf1c41cf/roles/910e8004690649e3b4fc1c4be76ad967` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:31.625044 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b30d1b-a6ab-49f3-9616-b48462679e84 None admin] RBAC: Authorizing `identity:create_grant(project_id=45f63f10100747b9b9eaf0e3e8021980, user_id=7dd7e4f0eebc45109a645be5cf1c41cf, role_id=910e8004690649e3b4fc1c4be76ad967)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:31.627268 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b30d1b-a6ab-49f3-9616-b48462679e84 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:31.686808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde6b82-8b5a-404f-b112-1b2629579f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:31.687956 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde6b82-8b5a-404f-b112-1b2629579f15 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:31.688467 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde6b82-8b5a-404f-b112-1b2629579f15 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:31.689058 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde6b82-8b5a-404f-b112-1b2629579f15 None admin] PATH_INFO: `/v3/users/a67df8a580e643139ad1366b40106e72` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:31.691617 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde6b82-8b5a-404f-b112-1b2629579f15 None admin] RBAC: Authorizing `identity:get_user(user_id=a67df8a580e643139ad1366b40106e72)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:31.693471 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde6b82-8b5a-404f-b112-1b2629579f15 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:31.695783 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 126/259] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:31 2022] GET /identity/v3/users/a67df8a580e643139ad1366b40106e72 => generated 283 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:31.701280 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde6b82-8b5a-404f-b112-1b2629579f15 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:31.706290 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:31.743588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 134/260] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 20:28:31 2022] PUT /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980/users/7dd7e4f0eebc45109a645be5cf1c41cf/roles/910e8004690649e3b4fc1c4be76ad967 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:28:31.861129 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde6b82-8b5a-404f-b112-1b2629579f15 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:31.908150 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e62e2-d3ec-42a1-8509-df39c1203680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:31.909213 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e62e2-d3ec-42a1-8509-df39c1203680 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:31.909709 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e62e2-d3ec-42a1-8509-df39c1203680 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:31.910191 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e62e2-d3ec-42a1-8509-df39c1203680 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:31.928273 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b30d1b-a6ab-49f3-9616-b48462679e84 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:31.938444 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:32.008324 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e62e2-d3ec-42a1-8509-df39c1203680 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:32.010381 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e62e2-d3ec-42a1-8509-df39c1203680 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:32.013967 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:32.143504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 127/261] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 20:28:32.149798 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e62e2-d3ec-42a1-8509-df39c1203680 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:32.174160 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b30d1b-a6ab-49f3-9616-b48462679e84 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:32.268581 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac9c11-f9d2-4173-b6be-0cad5c4e8ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:32.269605 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac9c11-f9d2-4173-b6be-0cad5c4e8ebc None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:32.271225 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac9c11-f9d2-4173-b6be-0cad5c4e8ebc None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:32.271785 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac9c11-f9d2-4173-b6be-0cad5c4e8ebc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:32.299287 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac9c11-f9d2-4173-b6be-0cad5c4e8ebc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:32.311312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-67ac9c11-f9d2-4173-b6be-0cad5c4e8ebc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:32.311312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:32.311312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:32.311312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:32.311312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:32.311312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:32.311312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:32.311312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:32.311312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:32.311312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:32.311312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:32.311312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:32.311312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:32.311312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:32.311312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:32.311312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:32.312849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:32.312849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:32.312849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:32.312849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:32.312849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:32.312849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:32.312849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:32.312849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:32.312849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:32.312849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:32.312849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:32.312849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:32.312849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:32.312849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:32.312849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:32.312849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:32.313723 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:32.313723 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:32.313723 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:32.313723 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:32.313723 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:32.313723 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:32.313723 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:32.313723 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:32.313723 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:32.313723 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:32.313723 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:32.313723 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:28:32.317711 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 135/262] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 20:28:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:32.325434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac9c11-f9d2-4173-b6be-0cad5c4e8ebc None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:32.379490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e62e2-d3ec-42a1-8509-df39c1203680 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:32.383472 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:32.405511 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:32.433755 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d50c6-1e83-4335-8721-753dd8afafcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:32.435023 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d50c6-1e83-4335-8721-753dd8afafcc None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:32.435669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d50c6-1e83-4335-8721-753dd8afafcc None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:32.436246 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d50c6-1e83-4335-8721-753dd8afafcc None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:32.439944 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d50c6-1e83-4335-8721-753dd8afafcc None admin] RBAC: Authorizing `identity:get_project(project_id=45f63f10100747b9b9eaf0e3e8021980)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:32.443765 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d50c6-1e83-4335-8721-753dd8afafcc None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:32.451786 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 128/263] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:32 2022] GET /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980 => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:32.467064 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d50c6-1e83-4335-8721-753dd8afafcc None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:32.507004 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac9c11-f9d2-4173-b6be-0cad5c4e8ebc None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:32.648399 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cb929-5ef7-4b82-85a3-ead6a6e35287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:32.649054 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cb929-5ef7-4b82-85a3-ead6a6e35287 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:32.649336 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cb929-5ef7-4b82-85a3-ead6a6e35287 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:32.649611 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cb929-5ef7-4b82-85a3-ead6a6e35287 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:32.650323 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cb929-5ef7-4b82-85a3-ead6a6e35287 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:32.650635 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cb929-5ef7-4b82-85a3-ead6a6e35287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:32.652171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cb929-5ef7-4b82-85a3-ead6a6e35287 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:32.669377 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 136/264] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:32.703821 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cb929-5ef7-4b82-85a3-ead6a6e35287 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:32.758610 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d50c6-1e83-4335-8721-753dd8afafcc None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:32.888099 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fffbe-6469-4179-a9db-c7e4a1510afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:32.889165 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fffbe-6469-4179-a9db-c7e4a1510afa None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:32.890260 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fffbe-6469-4179-a9db-c7e4a1510afa None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:32.890752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fffbe-6469-4179-a9db-c7e4a1510afa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:32.892175 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fffbe-6469-4179-a9db-c7e4a1510afa None admin] RBAC: Adding query filter params (role.id=fcd9a48e6c4b4c048380a57be435c3dd, scope.project.id=45f63f10100747b9b9eaf0e3e8021980, user.id=a67df8a580e643139ad1366b40106e72) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:32.892746 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fffbe-6469-4179-a9db-c7e4a1510afa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:32.900830 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fffbe-6469-4179-a9db-c7e4a1510afa None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:32.934569 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 129/265] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:28:32 2022] GET /identity/v3/role_assignments?user.id=a67df8a580e643139ad1366b40106e72&scope.project.id=45f63f10100747b9b9eaf0e3e8021980&role.id=fcd9a48e6c4b4c048380a57be435c3dd => generated 608 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:33.021064 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cb929-5ef7-4b82-85a3-ead6a6e35287 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:33.076119 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:33.090737 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ba88c-c22f-420b-86b1-709487ff985d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:33.091772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ba88c-c22f-420b-86b1-709487ff985d None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:33.092229 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ba88c-c22f-420b-86b1-709487ff985d None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:33.092899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ba88c-c22f-420b-86b1-709487ff985d None admin] PATH_INFO: `/v3/users/a67df8a580e643139ad1366b40106e72` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:33.095055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ba88c-c22f-420b-86b1-709487ff985d None admin] RBAC: Authorizing `identity:get_user(user_id=a67df8a580e643139ad1366b40106e72)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:33.097851 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ba88c-c22f-420b-86b1-709487ff985d None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:33.103623 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 137/266] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:32 2022] GET /identity/v3/users/a67df8a580e643139ad1366b40106e72 => generated 283 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:33.111394 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fffbe-6469-4179-a9db-c7e4a1510afa None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:33.197067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:33.289349 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fffbe-6469-4179-a9db-c7e4a1510afa None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:33.342094 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a947cf7-02c2-4218-84f8-ab93f039e586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:33.343614 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a947cf7-02c2-4218-84f8-ab93f039e586 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:33.344189 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a947cf7-02c2-4218-84f8-ab93f039e586 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:33.344672 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a947cf7-02c2-4218-84f8-ab93f039e586 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:33.411939 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f28c54-3f6e-4329-b11a-2a92bc37af4a None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:33.412456 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f28c54-3f6e-4329-b11a-2a92bc37af4a None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:33.412957 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f28c54-3f6e-4329-b11a-2a92bc37af4a None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:33.415536 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 138/267] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:33.423066 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbd0c9-f7fb-4e04-a2ec-ad7ffe2bbbee None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:33.423712 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbd0c9-f7fb-4e04-a2ec-ad7ffe2bbbee None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:33.424366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbd0c9-f7fb-4e04-a2ec-ad7ffe2bbbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:33.447619 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a947cf7-02c2-4218-84f8-ab93f039e586 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:33.449114 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a947cf7-02c2-4218-84f8-ab93f039e586 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:33.462789 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-32dbd0c9-f7fb-4e04-a2ec-ad7ffe2bbbee None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:33.464052 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-32dbd0c9-f7fb-4e04-a2ec-ad7ffe2bbbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:33.550777 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:33.616002 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 139/268] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:28:33.684407 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 130/269] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 20:28:33.693669 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbd0c9-f7fb-4e04-a2ec-ad7ffe2bbbee None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:33.842173 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbd0c9-f7fb-4e04-a2ec-ad7ffe2bbbee None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:33.883897 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:33.896546 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0451f41-f559-4dd0-8c13-c0a86fa555c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:33.897208 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0451f41-f559-4dd0-8c13-c0a86fa555c5 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:33.897492 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0451f41-f559-4dd0-8c13-c0a86fa555c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:33.897778 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0451f41-f559-4dd0-8c13-c0a86fa555c5 None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:33.900990 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0451f41-f559-4dd0-8c13-c0a86fa555c5 None admin] RBAC: Authorizing `identity:get_project(project_id=45f63f10100747b9b9eaf0e3e8021980)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:33.902534 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0451f41-f559-4dd0-8c13-c0a86fa555c5 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:33.904721 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 140/270] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:33 2022] GET /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:33.914805 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a947cf7-02c2-4218-84f8-ab93f039e586 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:34.057676 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0451f41-f559-4dd0-8c13-c0a86fa555c5 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:34.145292 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a947cf7-02c2-4218-84f8-ab93f039e586 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:34.213649 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f4dfa-5191-43b2-a120-404889b47ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:34.214783 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f4dfa-5191-43b2-a120-404889b47ec8 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:34.215567 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f4dfa-5191-43b2-a120-404889b47ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:34.216074 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f4dfa-5191-43b2-a120-404889b47ec8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:34.217531 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f4dfa-5191-43b2-a120-404889b47ec8 None admin] RBAC: Adding query filter params (role.id=1e3ce9c8b9934a7bb515b39e21fc1d68, scope.project.id=45f63f10100747b9b9eaf0e3e8021980, user.id=a67df8a580e643139ad1366b40106e72) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:34.218120 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f4dfa-5191-43b2-a120-404889b47ec8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:34.220955 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f4dfa-5191-43b2-a120-404889b47ec8 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:34.226943 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:34.237708 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 131/271] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:28:33 2022] GET /identity/v3/role_assignments?user.id=a67df8a580e643139ad1366b40106e72&scope.project.id=45f63f10100747b9b9eaf0e3e8021980&role.id=1e3ce9c8b9934a7bb515b39e21fc1d68 => generated 608 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:34.237708 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88380302-dc9a-4bc0-8dd6-0375733683ee None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:34.237708 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88380302-dc9a-4bc0-8dd6-0375733683ee None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:34.237708 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88380302-dc9a-4bc0-8dd6-0375733683ee None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:34.239309 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 132/272] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:34.248548 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e58e2-77fc-4754-8458-e622e5920b33 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:34.249054 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e58e2-77fc-4754-8458-e622e5920b33 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:34.252736 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e58e2-77fc-4754-8458-e622e5920b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:34.284241 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0451f41-f559-4dd0-8c13-c0a86fa555c5 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:34.286665 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-025e58e2-77fc-4754-8458-e622e5920b33 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:34.287948 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-025e58e2-77fc-4754-8458-e622e5920b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:34.364968 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c023fbb-f79e-4769-932e-d384394a1423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:34.365642 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c023fbb-f79e-4769-932e-d384394a1423 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:34.365925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c023fbb-f79e-4769-932e-d384394a1423 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:34.366202 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c023fbb-f79e-4769-932e-d384394a1423 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:34.390948 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c023fbb-f79e-4769-932e-d384394a1423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:34.396118 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-0c023fbb-f79e-4769-932e-d384394a1423 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:34.396118 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:34.396118 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:34.396118 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:34.396118 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:34.396118 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:34.396118 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:34.396118 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:34.396118 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:34.396118 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:34.396118 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:34.396118 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:34.396118 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:34.396118 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:34.396118 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:34.396118 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:34.397036 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:34.397036 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:34.397036 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:34.397036 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:34.397036 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:34.397036 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:34.397036 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:34.397036 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:34.397036 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:34.397036 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:34.397036 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:34.397036 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:34.397036 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:34.397036 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:34.397036 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:34.397036 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:34.397834 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:34.397834 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:34.397834 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:34.397834 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:34.397834 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:34.397834 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:34.397834 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:34.397834 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:34.397834 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:34.397834 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:34.397834 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:34.397834 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:28:34.397834 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 141/273] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:34.411705 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c023fbb-f79e-4769-932e-d384394a1423 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:34.449449 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 133/274] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:34.518867 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:34.597898 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c023fbb-f79e-4769-932e-d384394a1423 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:34.638074 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d812a-7f1b-4e8e-ac8d-c3600658f861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:34.638700 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d812a-7f1b-4e8e-ac8d-c3600658f861 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:34.638981 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d812a-7f1b-4e8e-ac8d-c3600658f861 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:34.639255 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d812a-7f1b-4e8e-ac8d-c3600658f861 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:34.640625 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d812a-7f1b-4e8e-ac8d-c3600658f861 None admin] RBAC: Adding query filter params (name=member) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:34.640930 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d812a-7f1b-4e8e-ac8d-c3600658f861 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:34.642331 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d812a-7f1b-4e8e-ac8d-c3600658f861 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:34.653648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 142/275] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:34.663187 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e58e2-77fc-4754-8458-e622e5920b33 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:34.866925 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e58e2-77fc-4754-8458-e622e5920b33 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:34.927217 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:34.934750 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad57217-3686-489d-b2fd-1ab4f7556b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:34.935464 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad57217-3686-489d-b2fd-1ab4f7556b08 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:34.935821 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad57217-3686-489d-b2fd-1ab4f7556b08 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:34.936066 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad57217-3686-489d-b2fd-1ab4f7556b08 None admin] PATH_INFO: `/v3/users/aff4d53cbf7543d196b23ffc90478b01` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:34.956141 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad57217-3686-489d-b2fd-1ab4f7556b08 None admin] RBAC: Authorizing `identity:get_user(user_id=aff4d53cbf7543d196b23ffc90478b01)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:34.957709 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad57217-3686-489d-b2fd-1ab4f7556b08 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:34.959839 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 134/276] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:34 2022] GET /identity/v3/users/aff4d53cbf7543d196b23ffc90478b01 => generated 293 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:34.969543 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d812a-7f1b-4e8e-ac8d-c3600658f861 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:35.089611 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad57217-3686-489d-b2fd-1ab4f7556b08 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:35.123429 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d812a-7f1b-4e8e-ac8d-c3600658f861 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:35.156068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:35.195168 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d02ad1-3527-49b8-ad2b-364ec2f5d604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:35.196687 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d02ad1-3527-49b8-ad2b-364ec2f5d604 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:35.197175 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d02ad1-3527-49b8-ad2b-364ec2f5d604 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:35.197669 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d02ad1-3527-49b8-ad2b-364ec2f5d604 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:35.199368 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d02ad1-3527-49b8-ad2b-364ec2f5d604 None admin] RBAC: Adding query filter params (role.id=910e8004690649e3b4fc1c4be76ad967, user.id=aff4d53cbf7543d196b23ffc90478b01, scope.system=all) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:35.199952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d02ad1-3527-49b8-ad2b-364ec2f5d604 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:35.203474 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d02ad1-3527-49b8-ad2b-364ec2f5d604 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:35.219614 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 143/277] 10.222.0.15 () {56 vars in 1308 bytes} [Mon Aug 22 20:28:34 2022] GET /identity/v3/role_assignments?user.id=aff4d53cbf7543d196b23ffc90478b01&scope.system=all&role.id=910e8004690649e3b4fc1c4be76ad967 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:35.219614 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742965fa-7a8c-49d1-aabf-01f352230618 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:35.219614 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742965fa-7a8c-49d1-aabf-01f352230618 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:35.219614 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742965fa-7a8c-49d1-aabf-01f352230618 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:35.224278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 144/278] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:35.230716 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0fad1-7b60-4968-a226-6dc87c3c2052 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:35.231168 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0fad1-7b60-4968-a226-6dc87c3c2052 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:35.231683 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0fad1-7b60-4968-a226-6dc87c3c2052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:35.266240 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-03c0fad1-7b60-4968-a226-6dc87c3c2052 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:35.268551 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-03c0fad1-7b60-4968-a226-6dc87c3c2052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:35.307347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad57217-3686-489d-b2fd-1ab4f7556b08 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:35.369745 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833eb7be-261f-4ef9-862d-d28e98f3f3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:35.370776 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eb7be-261f-4ef9-862d-d28e98f3f3d3 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:35.371222 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eb7be-261f-4ef9-862d-d28e98f3f3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:35.371687 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eb7be-261f-4ef9-862d-d28e98f3f3d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:35.373605 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833eb7be-261f-4ef9-862d-d28e98f3f3d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:35.376985 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833eb7be-261f-4ef9-862d-d28e98f3f3d3 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:35.379832 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 135/279] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:28:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:35.381616 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8283af-f768-4451-9841-cf9a2184199e None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:35.382050 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8283af-f768-4451-9841-cf9a2184199e None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:35.382462 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8283af-f768-4451-9841-cf9a2184199e None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:35.384796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 136/280] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:35.389031 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8283af-f768-4451-9841-cf9a2184199e None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:35.412099 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 145/281] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:35.414225 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631c0be-16de-4511-b27c-bfb1d55c255f None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:35.414848 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631c0be-16de-4511-b27c-bfb1d55c255f None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:35.415330 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631c0be-16de-4511-b27c-bfb1d55c255f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:35.442703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-6631c0be-16de-4511-b27c-bfb1d55c255f None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:35.444791 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-6631c0be-16de-4511-b27c-bfb1d55c255f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:35.486274 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:35.566350 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 146/282] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:35.567639 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8283af-f768-4451-9841-cf9a2184199e None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:35.607423 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2a8c3-e9c8-4a63-82f3-0df72fc6eb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:35.608540 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2a8c3-e9c8-4a63-82f3-0df72fc6eb8c None admin] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:35.609557 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2a8c3-e9c8-4a63-82f3-0df72fc6eb8c None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:35.610033 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2a8c3-e9c8-4a63-82f3-0df72fc6eb8c None admin] PATH_INFO: `/v3/users` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:35.610908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2a8c3-e9c8-4a63-82f3-0df72fc6eb8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:35.612638 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2a8c3-e9c8-4a63-82f3-0df72fc6eb8c None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:35.749990 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 137/283] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 20:28:35 2022] POST /identity/v3/users => generated 293 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:28:35.903209 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631c0be-16de-4511-b27c-bfb1d55c255f None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:35.953524 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2a8c3-e9c8-4a63-82f3-0df72fc6eb8c None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:35.981502 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:36.083386 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631c0be-16de-4511-b27c-bfb1d55c255f None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:36.144137 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2a8c3-e9c8-4a63-82f3-0df72fc6eb8c None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:36.148424 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91435b17-ce0d-4653-8a52-4b0bcad38d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:36.149421 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91435b17-ce0d-4653-8a52-4b0bcad38d37 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:36.149962 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91435b17-ce0d-4653-8a52-4b0bcad38d37 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:36.150524 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91435b17-ce0d-4653-8a52-4b0bcad38d37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:36.169315 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91435b17-ce0d-4653-8a52-4b0bcad38d37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:36.169849 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:36.174917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-91435b17-ce0d-4653-8a52-4b0bcad38d37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:36.174917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:36.174917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:36.174917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:36.174917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:36.174917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:36.174917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:36.174917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:36.174917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:36.174917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:36.174917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:36.174917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:36.174917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:36.174917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:36.174917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:36.174917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:36.183065 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:36.183065 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:36.183065 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:36.183065 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:36.183065 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:36.183065 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:36.183065 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:36.183065 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:36.183065 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:36.183065 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:36.183065 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:36.183065 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:36.183065 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:36.183065 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:36.183065 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:36.183065 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:36.184161 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:36.184161 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:36.184161 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:36.184161 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:36.184161 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:36.184161 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:36.184161 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:36.184161 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:36.184161 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:36.184161 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:36.184161 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:36.184161 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:28:36.184161 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 147/284] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:36.184161 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91435b17-ce0d-4653-8a52-4b0bcad38d37 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:36.209781 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b48124-cba9-4c94-b8f8-22d8a7e2fa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:36.210796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b48124-cba9-4c94-b8f8-22d8a7e2fa5f None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:36.211135 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b48124-cba9-4c94-b8f8-22d8a7e2fa5f None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:36.211410 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b48124-cba9-4c94-b8f8-22d8a7e2fa5f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:36.229164 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b48124-cba9-4c94-b8f8-22d8a7e2fa5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:36.234359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-b7b48124-cba9-4c94-b8f8-22d8a7e2fa5f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:28:36.234359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:36.234359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:36.234359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:36.234359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:36.234359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:36.234359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:36.234359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:36.234359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:36.234359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:36.234359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:36.234359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:36.234359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:36.234359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:36.234359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:36.234359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:36.235277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:36.235277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:36.235277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:36.235277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:36.235277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:36.235277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:36.235277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:36.235277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:36.235277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:36.235277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:36.235277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:36.235277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:36.235277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:36.235277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:36.235277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:36.235277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:36.236126 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:36.236126 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:36.236126 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:36.236126 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:36.236126 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:36.236126 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:36.236126 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:36.236126 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:36.236126 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:36.236126 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:36.236126 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:28:36.236126 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:36.236126 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 138/285] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:36.242992 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b48124-cba9-4c94-b8f8-22d8a7e2fa5f None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:36.346982 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:36.350987 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91435b17-ce0d-4653-8a52-4b0bcad38d37 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:36.398249 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81821f7-fc0e-48af-a006-c944940eeb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:36.398895 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81821f7-fc0e-48af-a006-c944940eeb41 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:36.399270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81821f7-fc0e-48af-a006-c944940eeb41 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:36.399565 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81821f7-fc0e-48af-a006-c944940eeb41 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:36.400526 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81821f7-fc0e-48af-a006-c944940eeb41 None admin] RBAC: Adding query filter params (name=member) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:36.400953 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81821f7-fc0e-48af-a006-c944940eeb41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:36.402432 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81821f7-fc0e-48af-a006-c944940eeb41 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:36.403403 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b48124-cba9-4c94-b8f8-22d8a7e2fa5f None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:36.414384 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 148/286] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:36.424061 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81821f7-fc0e-48af-a006-c944940eeb41 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:36.515986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a3c99-fc87-427d-ae93-83bd9a3616c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:36.517014 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a3c99-fc87-427d-ae93-83bd9a3616c8 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:36.517510 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a3c99-fc87-427d-ae93-83bd9a3616c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:36.517963 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a3c99-fc87-427d-ae93-83bd9a3616c8 None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:36.518835 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a3c99-fc87-427d-ae93-83bd9a3616c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:36.519331 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a3c99-fc87-427d-ae93-83bd9a3616c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:36.521081 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a3c99-fc87-427d-ae93-83bd9a3616c8 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:36.547791 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 139/287] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:36.551371 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81821f7-fc0e-48af-a006-c944940eeb41 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:36.553849 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a3c99-fc87-427d-ae93-83bd9a3616c8 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:36.596002 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa133bb4-de40-4e4a-baa5-a8909f573ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:36.596848 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa133bb4-de40-4e4a-baa5-a8909f573ee5 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:36.597193 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa133bb4-de40-4e4a-baa5-a8909f573ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:36.597411 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa133bb4-de40-4e4a-baa5-a8909f573ee5 None admin] PATH_INFO: `/v3/users/7dd7e4f0eebc45109a645be5cf1c41cf` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:36.599050 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa133bb4-de40-4e4a-baa5-a8909f573ee5 None admin] RBAC: Authorizing `identity:get_user(user_id=7dd7e4f0eebc45109a645be5cf1c41cf)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:36.600700 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa133bb4-de40-4e4a-baa5-a8909f573ee5 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:36.603360 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 149/288] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:36 2022] GET /identity/v3/users/7dd7e4f0eebc45109a645be5cf1c41cf => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:36.608079 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa133bb4-de40-4e4a-baa5-a8909f573ee5 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:36.646856 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:36.656278 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:36.735456 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa133bb4-de40-4e4a-baa5-a8909f573ee5 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:36.785032 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25b864-b134-46bb-adac-de31c8b49fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:36.785659 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25b864-b134-46bb-adac-de31c8b49fec None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:36.785940 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25b864-b134-46bb-adac-de31c8b49fec None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:36.786214 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25b864-b134-46bb-adac-de31c8b49fec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:36.861808 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25b864-b134-46bb-adac-de31c8b49fec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:36.863214 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25b864-b134-46bb-adac-de31c8b49fec None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:36.887067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a3c99-fc87-427d-ae93-83bd9a3616c8 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:36.955955 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:36.980644 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dba074-aeed-4acd-bb29-6444961263e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:36.982187 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dba074-aeed-4acd-bb29-6444961263e2 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:36.983024 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dba074-aeed-4acd-bb29-6444961263e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:36.983861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dba074-aeed-4acd-bb29-6444961263e2 None admin] PATH_INFO: `/v3/users/c89c346d98fc47198bce08a178905738` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:36.986420 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dba074-aeed-4acd-bb29-6444961263e2 None admin] RBAC: Authorizing `identity:get_user(user_id=c89c346d98fc47198bce08a178905738)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:36.989621 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dba074-aeed-4acd-bb29-6444961263e2 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:36.993616 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 140/289] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:36 2022] GET /identity/v3/users/c89c346d98fc47198bce08a178905738 => generated 297 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:37.003870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dba074-aeed-4acd-bb29-6444961263e2 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:37.105901 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 150/290] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:28:37.111578 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25b864-b134-46bb-adac-de31c8b49fec None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:37.244486 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dba074-aeed-4acd-bb29-6444961263e2 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:37.247539 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:37.266997 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25b864-b134-46bb-adac-de31c8b49fec None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:37.285268 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192cd85-aa38-4cd6-b1ac-4b0584a5bde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:37.286127 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192cd85-aa38-4cd6-b1ac-4b0584a5bde9 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:37.286274 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192cd85-aa38-4cd6-b1ac-4b0584a5bde9 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:37.286566 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192cd85-aa38-4cd6-b1ac-4b0584a5bde9 None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:37.287762 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192cd85-aa38-4cd6-b1ac-4b0584a5bde9 None admin] RBAC: Authorizing `identity:get_project(project_id=45f63f10100747b9b9eaf0e3e8021980)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:37.289282 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192cd85-aa38-4cd6-b1ac-4b0584a5bde9 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:37.291335 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 141/291] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:37 2022] GET /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:37.300662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:37.301329 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192cd85-aa38-4cd6-b1ac-4b0584a5bde9 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:37.304887 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a213d-69df-4b7f-8f99-2135b9cf0a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:37.305542 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a213d-69df-4b7f-8f99-2135b9cf0a00 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:37.305822 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a213d-69df-4b7f-8f99-2135b9cf0a00 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:37.306101 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a213d-69df-4b7f-8f99-2135b9cf0a00 None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:37.307278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a213d-69df-4b7f-8f99-2135b9cf0a00 None admin] RBAC: Authorizing `identity:get_project(project_id=45f63f10100747b9b9eaf0e3e8021980)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:37.309024 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a213d-69df-4b7f-8f99-2135b9cf0a00 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:37.312293 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 151/292] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:37 2022] GET /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:37.322709 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a213d-69df-4b7f-8f99-2135b9cf0a00 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:37.516224 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192cd85-aa38-4cd6-b1ac-4b0584a5bde9 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:37.563043 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a213d-69df-4b7f-8f99-2135b9cf0a00 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:37.578972 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeda7a8-a63a-4708-926b-41b8435dcd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:37.580119 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeda7a8-a63a-4708-926b-41b8435dcd96 None admin] REQUEST_METHOD: `PUT` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:37.580609 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeda7a8-a63a-4708-926b-41b8435dcd96 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:37.581101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeda7a8-a63a-4708-926b-41b8435dcd96 None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980/users/c89c346d98fc47198bce08a178905738/roles/147cb5e8478b42c0908186e1c2df0e55` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:37.584897 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeda7a8-a63a-4708-926b-41b8435dcd96 None admin] RBAC: Authorizing `identity:create_grant(project_id=45f63f10100747b9b9eaf0e3e8021980, user_id=c89c346d98fc47198bce08a178905738, role_id=147cb5e8478b42c0908186e1c2df0e55)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:37.595571 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeda7a8-a63a-4708-926b-41b8435dcd96 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:37.654389 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c350ec-b117-46f8-b9ed-efc6144e9dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:37.655596 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c350ec-b117-46f8-b9ed-efc6144e9dd9 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:37.656096 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c350ec-b117-46f8-b9ed-efc6144e9dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:37.656568 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c350ec-b117-46f8-b9ed-efc6144e9dd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:37.657885 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c350ec-b117-46f8-b9ed-efc6144e9dd9 None admin] RBAC: Adding query filter params (role.id=910e8004690649e3b4fc1c4be76ad967, scope.project.id=45f63f10100747b9b9eaf0e3e8021980, user.id=7dd7e4f0eebc45109a645be5cf1c41cf) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:37.658405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c350ec-b117-46f8-b9ed-efc6144e9dd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:37.661061 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c350ec-b117-46f8-b9ed-efc6144e9dd9 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:37.680190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 142/293] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 20:28:37 2022] PUT /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980/users/c89c346d98fc47198bce08a178905738/roles/147cb5e8478b42c0908186e1c2df0e55 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:28:37.684040 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 152/294] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:28:37 2022] GET /identity/v3/role_assignments?user.id=7dd7e4f0eebc45109a645be5cf1c41cf&scope.project.id=45f63f10100747b9b9eaf0e3e8021980&role.id=910e8004690649e3b4fc1c4be76ad967 => generated 608 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:38.487835 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4eb75c-c45c-459f-b941-2b366be9289d None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:38.488217 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4eb75c-c45c-459f-b941-2b366be9289d None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:38.488610 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4eb75c-c45c-459f-b941-2b366be9289d None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:38.490662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 143/295] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:38.496475 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb2af4-fe1a-41df-b6e9-a3b0bada7c26 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:38.496915 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb2af4-fe1a-41df-b6e9-a3b0bada7c26 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:38.497268 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb2af4-fe1a-41df-b6e9-a3b0bada7c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:38.529790 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-51bb2af4-fe1a-41df-b6e9-a3b0bada7c26 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:38.529790 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-51bb2af4-fe1a-41df-b6e9-a3b0bada7c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:38.599632 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:38.612510 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 153/296] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:38.967461 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e3e80-a210-4e84-b8fe-13a3a03ae540 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:38.968657 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e3e80-a210-4e84-b8fe-13a3a03ae540 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:38.968657 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e3e80-a210-4e84-b8fe-13a3a03ae540 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:38.970182 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 144/297] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:38.972081 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d93ba7-454e-4062-82e8-2c091a809404 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:38.972792 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e3e80-a210-4e84-b8fe-13a3a03ae540 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:38.973057 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d93ba7-454e-4062-82e8-2c091a809404 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:38.973489 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d93ba7-454e-4062-82e8-2c091a809404 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:38.975346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 154/298] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:38.977183 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e801b7-9c2d-440d-946a-5f0aa5461528 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:38.977531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e801b7-9c2d-440d-946a-5f0aa5461528 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:38.977871 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e801b7-9c2d-440d-946a-5f0aa5461528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:38.999872 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-c3e801b7-9c2d-440d-946a-5f0aa5461528 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:39.001107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-c3e801b7-9c2d-440d-946a-5f0aa5461528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:39.014517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:39.088294 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 155/299] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:39.089884 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c57f0c-bf84-4782-acee-b7da6c87684d None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:39.090167 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c57f0c-bf84-4782-acee-b7da6c87684d None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:39.090439 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c57f0c-bf84-4782-acee-b7da6c87684d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:39.106223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e3e80-a210-4e84-b8fe-13a3a03ae540 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:39.114199 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-91c57f0c-bf84-4782-acee-b7da6c87684d None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:39.115508 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-91c57f0c-bf84-4782-acee-b7da6c87684d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:39.154774 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb22118-1f97-46bc-8c0f-23f4bd5f270a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:39.156666 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb22118-1f97-46bc-8c0f-23f4bd5f270a None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:39.156944 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb22118-1f97-46bc-8c0f-23f4bd5f270a None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:39.157212 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb22118-1f97-46bc-8c0f-23f4bd5f270a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:39.173575 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb22118-1f97-46bc-8c0f-23f4bd5f270a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:39.179600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-dcb22118-1f97-46bc-8c0f-23f4bd5f270a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:39.179600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:39.179600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:39.179600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:39.179600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:39.179600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:39.179600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:39.179600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:39.179600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:39.179600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:39.179600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:39.179600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:39.179600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:39.179600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:39.179600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:39.179600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:39.180521 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:39.180521 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:39.180521 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:39.180521 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:39.180521 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:39.180521 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:39.180521 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:39.180521 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:39.180521 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:39.180521 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:39.180521 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:39.180521 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:39.180521 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:39.180521 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:39.180521 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:39.180521 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:39.181309 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:39.181309 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:39.181309 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:39.181309 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:39.181309 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:39.181309 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:39.181309 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:39.181309 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:39.181309 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:39.181309 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:39.181309 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:39.181309 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:39.181309 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 145/300] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:28:39.187297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb22118-1f97-46bc-8c0f-23f4bd5f270a None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:39.219826 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 156/301] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:39.360120 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:39.381169 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb22118-1f97-46bc-8c0f-23f4bd5f270a None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:39.448923 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53df5d6-56dc-4f86-8077-f30e8d628c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:39.449899 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53df5d6-56dc-4f86-8077-f30e8d628c5a None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:39.450364 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53df5d6-56dc-4f86-8077-f30e8d628c5a None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:39.450834 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53df5d6-56dc-4f86-8077-f30e8d628c5a None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:39.452020 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53df5d6-56dc-4f86-8077-f30e8d628c5a None admin] RBAC: Adding query filter params (name=member) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:39.453100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53df5d6-56dc-4f86-8077-f30e8d628c5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:39.455597 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53df5d6-56dc-4f86-8077-f30e8d628c5a None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:39.470790 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 146/302] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:39.479789 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c57f0c-bf84-4782-acee-b7da6c87684d None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:39.565324 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53df5d6-56dc-4f86-8077-f30e8d628c5a None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:39.578580 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:39.636590 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c57f0c-bf84-4782-acee-b7da6c87684d None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:39.699293 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4c13b-ec6d-4890-848c-24d1662089ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:39.700237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4c13b-ec6d-4890-848c-24d1662089ce None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:39.700579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4c13b-ec6d-4890-848c-24d1662089ce None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:39.700778 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4c13b-ec6d-4890-848c-24d1662089ce None admin] PATH_INFO: `/v3/users/aff4d53cbf7543d196b23ffc90478b01` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:39.702012 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4c13b-ec6d-4890-848c-24d1662089ce None admin] RBAC: Authorizing `identity:get_user(user_id=aff4d53cbf7543d196b23ffc90478b01)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:39.704113 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4c13b-ec6d-4890-848c-24d1662089ce None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:39.713140 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 157/303] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:39 2022] GET /identity/v3/users/aff4d53cbf7543d196b23ffc90478b01 => generated 293 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:39.713140 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4c13b-ec6d-4890-848c-24d1662089ce None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:39.744383 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53df5d6-56dc-4f86-8077-f30e8d628c5a None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:39.810162 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe627b04-3940-40f1-a746-dc37e1074f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:39.811244 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe627b04-3940-40f1-a746-dc37e1074f8a None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:39.811814 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe627b04-3940-40f1-a746-dc37e1074f8a None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:39.812782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe627b04-3940-40f1-a746-dc37e1074f8a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:39.832671 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe627b04-3940-40f1-a746-dc37e1074f8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:39.843125 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-fe627b04-3940-40f1-a746-dc37e1074f8a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:28:39.843125 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:39.843125 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:39.843125 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:39.843125 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:39.843125 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:39.843125 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:39.843125 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:39.843125 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:39.843125 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:39.843125 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:39.843125 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:39.843125 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:39.843125 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:39.843125 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:39.843125 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:39.844788 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:39.844788 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:39.844788 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:39.844788 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:39.844788 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:39.844788 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:39.844788 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:39.844788 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:39.844788 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:39.844788 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:39.844788 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:39.844788 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:39.844788 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:39.844788 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:39.844788 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:39.844788 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:39.846468 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:39.846468 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:39.846468 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:39.846468 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:39.846468 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:39.846468 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:39.846468 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:39.846468 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:39.846468 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:39.846468 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:39.846468 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:28:39.846468 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:39.846468 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 147/304] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:39.848044 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe627b04-3940-40f1-a746-dc37e1074f8a None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:39.863750 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4c13b-ec6d-4890-848c-24d1662089ce None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:39.866260 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:39.901032 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:39.925531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6b183-f4d8-4eeb-a1e6-5369df0289e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:39.926368 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6b183-f4d8-4eeb-a1e6-5369df0289e6 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:39.926698 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6b183-f4d8-4eeb-a1e6-5369df0289e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:39.927067 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6b183-f4d8-4eeb-a1e6-5369df0289e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:39.928922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6b183-f4d8-4eeb-a1e6-5369df0289e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:39.931438 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6b183-f4d8-4eeb-a1e6-5369df0289e6 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:39.934367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 158/305] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:28:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:39.935565 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6b183-f4d8-4eeb-a1e6-5369df0289e6 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:40.022742 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe627b04-3940-40f1-a746-dc37e1074f8a None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:40.065559 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769d666-c373-43e5-a296-4953ec6ac90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:40.066233 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769d666-c373-43e5-a296-4953ec6ac90b None admin] REQUEST_METHOD: `PUT` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:40.066511 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769d666-c373-43e5-a296-4953ec6ac90b None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:40.066782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769d666-c373-43e5-a296-4953ec6ac90b None admin] PATH_INFO: `/v3/system/users/aff4d53cbf7543d196b23ffc90478b01/roles/910e8004690649e3b4fc1c4be76ad967` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:40.068450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769d666-c373-43e5-a296-4953ec6ac90b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=aff4d53cbf7543d196b23ffc90478b01, role_id=910e8004690649e3b4fc1c4be76ad967)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:40.070293 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769d666-c373-43e5-a296-4953ec6ac90b None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:40.164745 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6b183-f4d8-4eeb-a1e6-5369df0289e6 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:40.219260 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db4931-c38d-4c73-b543-39d1287c0633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:40.219903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db4931-c38d-4c73-b543-39d1287c0633 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:40.220183 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db4931-c38d-4c73-b543-39d1287c0633 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:40.220532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db4931-c38d-4c73-b543-39d1287c0633 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:40.221142 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db4931-c38d-4c73-b543-39d1287c0633 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:40.221449 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db4931-c38d-4c73-b543-39d1287c0633 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:40.222838 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db4931-c38d-4c73-b543-39d1287c0633 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:40.232416 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 159/306] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:40.233258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db4931-c38d-4c73-b543-39d1287c0633 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:40.238298 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 148/307] 10.222.0.15 () {58 vars in 1334 bytes} [Mon Aug 22 20:28:39 2022] PUT /identity/v3/system/users/aff4d53cbf7543d196b23ffc90478b01/roles/910e8004690649e3b4fc1c4be76ad967 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:28:40.243280 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769d666-c373-43e5-a296-4953ec6ac90b None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:40.384001 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:40.440414 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:40.483669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769d666-c373-43e5-a296-4953ec6ac90b None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:40.501514 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db4931-c38d-4c73-b543-39d1287c0633 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:40.554181 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a172287-31f8-4822-bedd-2836eed92054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:40.555279 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a172287-31f8-4822-bedd-2836eed92054 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:40.555801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a172287-31f8-4822-bedd-2836eed92054 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:40.555971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65368a7d-9df7-4966-86ae-fe0aad0da865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:40.556258 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a172287-31f8-4822-bedd-2836eed92054 None admin] PATH_INFO: `/v3/users/e4145486082843feb6d5dc658c05db21` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:40.556960 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65368a7d-9df7-4966-86ae-fe0aad0da865 None admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:40.557449 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65368a7d-9df7-4966-86ae-fe0aad0da865 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:40.557932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65368a7d-9df7-4966-86ae-fe0aad0da865 None admin] PATH_INFO: `/v3/groups` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:40.559333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65368a7d-9df7-4966-86ae-fe0aad0da865 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:40.562261 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65368a7d-9df7-4966-86ae-fe0aad0da865 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:40.582382 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a172287-31f8-4822-bedd-2836eed92054 None admin] RBAC: Authorizing `identity:get_user(user_id=e4145486082843feb6d5dc658c05db21)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:40.587912 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a172287-31f8-4822-bedd-2836eed92054 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:40.588534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 149/308] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:40 2022] GET /identity/v3/users/e4145486082843feb6d5dc658c05db21 => generated 293 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:40.590422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff777477-1cab-40bb-b7e6-cb2f197a3011 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:40.590927 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff777477-1cab-40bb-b7e6-cb2f197a3011 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:40.591507 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff777477-1cab-40bb-b7e6-cb2f197a3011 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:40.595016 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 150/309] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:40.596422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff777477-1cab-40bb-b7e6-cb2f197a3011 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:40.666869 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 160/310] 10.222.0.15 () {60 vars in 1134 bytes} [Mon Aug 22 20:28:40 2022] POST /identity/v3/groups => generated 229 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:28:40.669421 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31dd8a-e9ba-4fa3-b6b1-1fa27b9665c0 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:40.670235 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31dd8a-e9ba-4fa3-b6b1-1fa27b9665c0 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:40.670601 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31dd8a-e9ba-4fa3-b6b1-1fa27b9665c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:40.702813 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-db31dd8a-e9ba-4fa3-b6b1-1fa27b9665c0 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:40.705080 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-db31dd8a-e9ba-4fa3-b6b1-1fa27b9665c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:40.748434 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff777477-1cab-40bb-b7e6-cb2f197a3011 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:40.822133 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b1775-6827-4711-b53b-aee709d2cc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:40.823032 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b1775-6827-4711-b53b-aee709d2cc77 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:40.823412 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b1775-6827-4711-b53b-aee709d2cc77 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:40.823835 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b1775-6827-4711-b53b-aee709d2cc77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:40.825263 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b1775-6827-4711-b53b-aee709d2cc77 None admin] RBAC: Adding query filter params (role.id=147cb5e8478b42c0908186e1c2df0e55, user.id=e4145486082843feb6d5dc658c05db21, scope.system=all) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:40.826120 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b1775-6827-4711-b53b-aee709d2cc77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:40.831261 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b1775-6827-4711-b53b-aee709d2cc77 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:40.837027 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:40.852202 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 151/311] 10.222.0.15 () {56 vars in 1308 bytes} [Mon Aug 22 20:28:40 2022] GET /identity/v3/role_assignments?user.id=e4145486082843feb6d5dc658c05db21&scope.system=all&role.id=147cb5e8478b42c0908186e1c2df0e55 => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:40.863071 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 161/312] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:41.208191 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b1775-6827-4711-b53b-aee709d2cc77 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:41.338610 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b1775-6827-4711-b53b-aee709d2cc77 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:41.403872 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d110767-cd90-42f2-a5cf-923aa30b3a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:41.404928 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d110767-cd90-42f2-a5cf-923aa30b3a1e None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:41.406047 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d110767-cd90-42f2-a5cf-923aa30b3a1e None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:41.406470 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d110767-cd90-42f2-a5cf-923aa30b3a1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:41.426760 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d110767-cd90-42f2-a5cf-923aa30b3a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:41.437029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-1d110767-cd90-42f2-a5cf-923aa30b3a1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:28:41.437029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:41.437029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:41.437029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:41.437029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:41.437029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:41.437029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:41.437029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:41.437029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:41.437029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:41.437029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:41.437029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:41.437029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:41.437029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:41.437029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:41.437029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:41.437999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:41.437999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:41.437999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:41.437999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:41.437999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:41.437999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:41.437999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:41.437999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:41.437999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:41.437999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:41.437999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:41.437999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:41.437999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:41.437999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:41.437999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:41.437999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:41.438789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:41.438789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:41.438789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:41.438789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:41.438789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:41.438789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:41.438789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:41.438789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:41.438789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:41.438789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:41.438789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:28:41.438789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:41.439998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 152/313] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:41.446548 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31dd8a-e9ba-4fa3-b6b1-1fa27b9665c0 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:41.495447 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:41.563492 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31dd8a-e9ba-4fa3-b6b1-1fa27b9665c0 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:41.607272 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c71b2-a455-4c70-bc42-ad1172a23cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:41.607944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c71b2-a455-4c70-bc42-ad1172a23cb0 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:41.608227 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c71b2-a455-4c70-bc42-ad1172a23cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:41.608567 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c71b2-a455-4c70-bc42-ad1172a23cb0 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:41.609788 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c71b2-a455-4c70-bc42-ad1172a23cb0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:41.610094 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c71b2-a455-4c70-bc42-ad1172a23cb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:41.611532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c71b2-a455-4c70-bc42-ad1172a23cb0 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:41.621712 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 162/314] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:41.629820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d110767-cd90-42f2-a5cf-923aa30b3a1e None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:41.715878 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:41.786113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d110767-cd90-42f2-a5cf-923aa30b3a1e None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:41.826659 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9c00c-e60e-49ff-8ac1-efad228043d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:41.827358 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9c00c-e60e-49ff-8ac1-efad228043d3 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:41.827676 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9c00c-e60e-49ff-8ac1-efad228043d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:41.827952 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9c00c-e60e-49ff-8ac1-efad228043d3 None admin] PATH_INFO: `/v3/users/c89c346d98fc47198bce08a178905738` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:41.829147 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9c00c-e60e-49ff-8ac1-efad228043d3 None admin] RBAC: Authorizing `identity:get_user(user_id=c89c346d98fc47198bce08a178905738)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:41.830769 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9c00c-e60e-49ff-8ac1-efad228043d3 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:41.832546 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 153/315] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:41 2022] GET /identity/v3/users/c89c346d98fc47198bce08a178905738 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:41.838414 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c71b2-a455-4c70-bc42-ad1172a23cb0 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:41.957791 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c71b2-a455-4c70-bc42-ad1172a23cb0 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:41.959630 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:41.998562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6058771-c8ba-484c-b6de-9afca7882b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:41.999218 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6058771-c8ba-484c-b6de-9afca7882b10 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:41.999505 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6058771-c8ba-484c-b6de-9afca7882b10 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:41.999818 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6058771-c8ba-484c-b6de-9afca7882b10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:42.078400 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6058771-c8ba-484c-b6de-9afca7882b10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:42.079966 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6058771-c8ba-484c-b6de-9afca7882b10 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:42.191884 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 163/316] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 20:28:42.198255 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9c00c-e60e-49ff-8ac1-efad228043d3 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:42.325654 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9c00c-e60e-49ff-8ac1-efad228043d3 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:42.354662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:42.363457 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f8f75-805a-4572-91cf-3511b9284839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:42.364124 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f8f75-805a-4572-91cf-3511b9284839 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:42.364449 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f8f75-805a-4572-91cf-3511b9284839 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:42.364740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f8f75-805a-4572-91cf-3511b9284839 None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:42.365941 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f8f75-805a-4572-91cf-3511b9284839 None admin] RBAC: Authorizing `identity:get_project(project_id=45f63f10100747b9b9eaf0e3e8021980)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:42.367413 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f8f75-805a-4572-91cf-3511b9284839 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:42.369363 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 154/317] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:42 2022] GET /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:42.377765 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6058771-c8ba-484c-b6de-9afca7882b10 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:42.384059 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:42.562977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6058771-c8ba-484c-b6de-9afca7882b10 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:42.602265 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842ab59-5d9b-4346-a4aa-7fddb5bbc28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:42.602893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842ab59-5d9b-4346-a4aa-7fddb5bbc28c None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:42.603220 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842ab59-5d9b-4346-a4aa-7fddb5bbc28c None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:42.603494 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842ab59-5d9b-4346-a4aa-7fddb5bbc28c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:42.604279 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842ab59-5d9b-4346-a4aa-7fddb5bbc28c None admin] RBAC: Adding query filter params (role.id=147cb5e8478b42c0908186e1c2df0e55, scope.project.id=45f63f10100747b9b9eaf0e3e8021980, user.id=c89c346d98fc47198bce08a178905738) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:42.604590 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842ab59-5d9b-4346-a4aa-7fddb5bbc28c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:42.606111 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842ab59-5d9b-4346-a4aa-7fddb5bbc28c None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:42.613212 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 164/318] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:28:42 2022] GET /identity/v3/role_assignments?user.id=c89c346d98fc47198bce08a178905738&scope.project.id=45f63f10100747b9b9eaf0e3e8021980&role.id=147cb5e8478b42c0908186e1c2df0e55 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:43.271470 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b98cfe-36bb-410d-bad0-bed7e62567ae None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:43.271800 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b98cfe-36bb-410d-bad0-bed7e62567ae None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:43.272074 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b98cfe-36bb-410d-bad0-bed7e62567ae None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:43.273942 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 155/319] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:28:43.281143 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6815c-68c9-4e37-9269-7e69ceac0abb None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:43.281786 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6815c-68c9-4e37-9269-7e69ceac0abb None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:43.282274 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6815c-68c9-4e37-9269-7e69ceac0abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:43.315317 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-3cc6815c-68c9-4e37-9269-7e69ceac0abb None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:43.317549 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-3cc6815c-68c9-4e37-9269-7e69ceac0abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:43.394603 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb2290-0724-433d-8bc8-ce6b59eeef03 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:43.395392 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb2290-0724-433d-8bc8-ce6b59eeef03 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:43.395392 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb2290-0724-433d-8bc8-ce6b59eeef03 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:43.396872 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 156/320] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:28:43.402283 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc1b97-dced-4cce-bba6-5e8a37ec1eff None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:43.402643 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc1b97-dced-4cce-bba6-5e8a37ec1eff None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:43.402885 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc1b97-dced-4cce-bba6-5e8a37ec1eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:43.422164 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-c6dc1b97-dced-4cce-bba6-5e8a37ec1eff None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:43.423401 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-c6dc1b97-dced-4cce-bba6-5e8a37ec1eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:43.437743 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:43.455791 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 165/321] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:28:43.513428 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 157/322] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:43.685156 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba3970-6361-4eb8-9bab-24449e657d4b None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:43.685949 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba3970-6361-4eb8-9bab-24449e657d4b None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:43.686117 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba3970-6361-4eb8-9bab-24449e657d4b None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:43.689449 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 166/323] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:43.697540 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b21378-0414-41d6-87b2-c036e59b98ce None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:43.697986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b21378-0414-41d6-87b2-c036e59b98ce None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:43.698424 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b21378-0414-41d6-87b2-c036e59b98ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:43.725845 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-89b21378-0414-41d6-87b2-c036e59b98ce None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:43.729982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-89b21378-0414-41d6-87b2-c036e59b98ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:43.809732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 158/324] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:28:43.908711 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba3970-6361-4eb8-9bab-24449e657d4b None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:44.037307 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba3970-6361-4eb8-9bab-24449e657d4b None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:44.080089 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b21378-0414-41d6-87b2-c036e59b98ce None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:44.083020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec43683-e300-4ddb-aeac-591c1d21e120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:44.083691 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43683-e300-4ddb-aeac-591c1d21e120 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:44.083974 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43683-e300-4ddb-aeac-591c1d21e120 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:44.084248 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43683-e300-4ddb-aeac-591c1d21e120 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:44.085433 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec43683-e300-4ddb-aeac-591c1d21e120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:44.086930 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec43683-e300-4ddb-aeac-591c1d21e120 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:44.088921 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 167/325] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:28:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:44.098027 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec43683-e300-4ddb-aeac-591c1d21e120 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:44.183198 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:44.191806 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:44.240164 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b21378-0414-41d6-87b2-c036e59b98ce None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:44.240687 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec43683-e300-4ddb-aeac-591c1d21e120 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:44.281350 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaaf925-caad-403f-af75-c104c56927e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:44.281978 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaf925-caad-403f-af75-c104c56927e7 None admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:44.282248 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaf925-caad-403f-af75-c104c56927e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:44.282518 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaf925-caad-403f-af75-c104c56927e7 None admin] PATH_INFO: `/v3/groups` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:44.283160 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaaf925-caad-403f-af75-c104c56927e7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:44.284030 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c970af9-95ec-418b-ad56-4a5fe511f3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:44.284669 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaaf925-caad-403f-af75-c104c56927e7 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:44.284831 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c970af9-95ec-418b-ad56-4a5fe511f3e9 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:44.285194 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c970af9-95ec-418b-ad56-4a5fe511f3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:44.285559 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c970af9-95ec-418b-ad56-4a5fe511f3e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:44.298641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c970af9-95ec-418b-ad56-4a5fe511f3e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:44.303750 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-4c970af9-95ec-418b-ad56-4a5fe511f3e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:44.303750 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:44.303750 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:44.303750 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:44.303750 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:44.303750 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:44.303750 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:44.303750 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:44.303750 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:44.303750 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:44.303750 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:44.303750 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:44.303750 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:44.303750 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:44.303750 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:44.303750 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:44.305347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:44.305347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:44.305347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:44.305347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:44.305347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:44.305347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:44.305347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:44.305347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:44.305347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:44.305347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:44.305347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:44.305347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:44.305347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:44.305347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:44.305347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:44.305347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:44.306861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:44.306861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:44.306861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:44.306861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:44.306861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:44.306861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:44.306861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:44.306861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:44.306861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:44.306861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:44.306861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:44.306861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:44.306861 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 159/326] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:44.308166 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c970af9-95ec-418b-ad56-4a5fe511f3e9 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:44.395903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 168/327] 10.222.0.15 () {60 vars in 1134 bytes} [Mon Aug 22 20:28:44 2022] POST /identity/v3/groups => generated 226 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:28:44.397743 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaaf925-caad-403f-af75-c104c56927e7 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:44.431016 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c970af9-95ec-418b-ad56-4a5fe511f3e9 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:44.451075 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:44.488055 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da516f6a-2111-4c6a-8d5b-e832f087be73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:44.489156 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da516f6a-2111-4c6a-8d5b-e832f087be73 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:44.489658 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da516f6a-2111-4c6a-8d5b-e832f087be73 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:44.490156 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da516f6a-2111-4c6a-8d5b-e832f087be73 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:44.511629 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da516f6a-2111-4c6a-8d5b-e832f087be73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:44.522360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-da516f6a-2111-4c6a-8d5b-e832f087be73 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:28:44.522360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:44.522360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:44.522360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:44.522360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:44.522360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:44.522360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:44.522360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:44.522360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:44.522360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:44.522360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:44.522360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:44.522360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:44.522360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:44.522360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:44.522360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:44.524159 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:44.524159 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:44.524159 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:44.524159 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:44.524159 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:44.524159 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:44.524159 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:44.524159 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:44.524159 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:44.524159 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:44.524159 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:44.524159 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:44.524159 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:44.524159 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:44.524159 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:44.524159 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:44.525735 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:44.525735 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:44.525735 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:44.525735 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:44.525735 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:44.525735 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:44.525735 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:44.525735 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:44.525735 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:44.525735 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:44.525735 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:28:44.525735 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:44.533998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 160/328] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:44.535809 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da516f6a-2111-4c6a-8d5b-e832f087be73 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:44.603318 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaaf925-caad-403f-af75-c104c56927e7 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:44.645156 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:44.668678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63883f-710f-4440-8702-49f5b49b2fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:44.668678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63883f-710f-4440-8702-49f5b49b2fda None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:44.668678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63883f-710f-4440-8702-49f5b49b2fda None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:44.668678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63883f-710f-4440-8702-49f5b49b2fda None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:44.669286 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63883f-710f-4440-8702-49f5b49b2fda None admin] RBAC: Adding query filter params (name=member) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:44.669286 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63883f-710f-4440-8702-49f5b49b2fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:44.669790 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63883f-710f-4440-8702-49f5b49b2fda None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:44.687156 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 169/329] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:44.694283 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63883f-710f-4440-8702-49f5b49b2fda None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:44.711343 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da516f6a-2111-4c6a-8d5b-e832f087be73 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:44.779669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123a944-52a7-4928-8267-f122b2540223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:44.780754 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123a944-52a7-4928-8267-f122b2540223 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:44.781230 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123a944-52a7-4928-8267-f122b2540223 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:44.781740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123a944-52a7-4928-8267-f122b2540223 None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:44.782666 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123a944-52a7-4928-8267-f122b2540223 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:44.783186 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123a944-52a7-4928-8267-f122b2540223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:44.785724 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123a944-52a7-4928-8267-f122b2540223 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:44.806363 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 161/330] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:44.807668 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123a944-52a7-4928-8267-f122b2540223 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:44.873674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:44.920137 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63883f-710f-4440-8702-49f5b49b2fda None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:44.981510 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab964ad8-038b-45ee-803d-9a3e020ce4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:44.982521 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab964ad8-038b-45ee-803d-9a3e020ce4a6 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:44.982974 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab964ad8-038b-45ee-803d-9a3e020ce4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:44.983445 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab964ad8-038b-45ee-803d-9a3e020ce4a6 None admin] PATH_INFO: `/v3/users/aff4d53cbf7543d196b23ffc90478b01` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:44.985494 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab964ad8-038b-45ee-803d-9a3e020ce4a6 None admin] RBAC: Authorizing `identity:get_user(user_id=aff4d53cbf7543d196b23ffc90478b01)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:44.989811 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab964ad8-038b-45ee-803d-9a3e020ce4a6 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:44.995637 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 170/331] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:44 2022] GET /identity/v3/users/aff4d53cbf7543d196b23ffc90478b01 => generated 293 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:45.000222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab964ad8-038b-45ee-803d-9a3e020ce4a6 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:45.019040 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123a944-52a7-4928-8267-f122b2540223 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:45.079389 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21375acc-3d52-40ff-bbef-6d45b21a36ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:45.080015 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21375acc-3d52-40ff-bbef-6d45b21a36ee None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:45.080497 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21375acc-3d52-40ff-bbef-6d45b21a36ee None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:45.080968 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21375acc-3d52-40ff-bbef-6d45b21a36ee None admin] PATH_INFO: `/v3/users/e4145486082843feb6d5dc658c05db21` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:45.083223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21375acc-3d52-40ff-bbef-6d45b21a36ee None admin] RBAC: Authorizing `identity:get_user(user_id=e4145486082843feb6d5dc658c05db21)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:45.087635 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21375acc-3d52-40ff-bbef-6d45b21a36ee None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:45.091623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 162/332] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:44 2022] GET /identity/v3/users/e4145486082843feb6d5dc658c05db21 => generated 293 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:45.098688 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:45.102828 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21375acc-3d52-40ff-bbef-6d45b21a36ee None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:45.158876 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab964ad8-038b-45ee-803d-9a3e020ce4a6 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:45.224687 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d277ee-6062-4003-ad1f-cfd4e73a66ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:45.225242 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d277ee-6062-4003-ad1f-cfd4e73a66ba None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:45.225503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d277ee-6062-4003-ad1f-cfd4e73a66ba None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:45.225771 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d277ee-6062-4003-ad1f-cfd4e73a66ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:45.226510 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d277ee-6062-4003-ad1f-cfd4e73a66ba None admin] RBAC: Adding query filter params (role.id=910e8004690649e3b4fc1c4be76ad967, user.id=aff4d53cbf7543d196b23ffc90478b01, scope.system=all) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:45.226816 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d277ee-6062-4003-ad1f-cfd4e73a66ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:45.229876 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d277ee-6062-4003-ad1f-cfd4e73a66ba None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:45.248735 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 171/333] 10.222.0.15 () {56 vars in 1308 bytes} [Mon Aug 22 20:28:44 2022] GET /identity/v3/role_assignments?user.id=aff4d53cbf7543d196b23ffc90478b01&scope.system=all&role.id=910e8004690649e3b4fc1c4be76ad967 => generated 510 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:45.307295 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21375acc-3d52-40ff-bbef-6d45b21a36ee None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:45.310464 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:45.368111 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6414f7-cdf1-46a1-bd87-4dad6df74017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:45.369259 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6414f7-cdf1-46a1-bd87-4dad6df74017 None admin] REQUEST_METHOD: `PUT` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:45.369753 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6414f7-cdf1-46a1-bd87-4dad6df74017 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:45.370231 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6414f7-cdf1-46a1-bd87-4dad6df74017 None admin] PATH_INFO: `/v3/system/users/e4145486082843feb6d5dc658c05db21/roles/147cb5e8478b42c0908186e1c2df0e55` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:45.372951 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6414f7-cdf1-46a1-bd87-4dad6df74017 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e4145486082843feb6d5dc658c05db21, role_id=147cb5e8478b42c0908186e1c2df0e55)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:45.376148 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6414f7-cdf1-46a1-bd87-4dad6df74017 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:45.451797 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 163/334] 10.222.0.15 () {58 vars in 1334 bytes} [Mon Aug 22 20:28:45 2022] PUT /identity/v3/system/users/e4145486082843feb6d5dc658c05db21/roles/147cb5e8478b42c0908186e1c2df0e55 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:28:48.075473 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059cf30-1169-481b-887f-4268df870707 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:48.076020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059cf30-1169-481b-887f-4268df870707 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:48.076020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059cf30-1169-481b-887f-4268df870707 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:48.077820 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 172/335] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:48.085080 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de35a0d-c949-4b3b-a6b4-2c554e5c4abb None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:48.085679 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de35a0d-c949-4b3b-a6b4-2c554e5c4abb None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:48.086078 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de35a0d-c949-4b3b-a6b4-2c554e5c4abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:48.129332 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-1de35a0d-c949-4b3b-a6b4-2c554e5c4abb None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:48.131360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-1de35a0d-c949-4b3b-a6b4-2c554e5c4abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:48.246635 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 164/336] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:48.641126 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d65acf-7c82-4b0e-91cf-75d3595e247f None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:48.641410 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d65acf-7c82-4b0e-91cf-75d3595e247f None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:48.641546 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec2064-2d77-4207-ab97-c9868322b543 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:48.641683 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d65acf-7c82-4b0e-91cf-75d3595e247f None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:48.642041 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec2064-2d77-4207-ab97-c9868322b543 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:48.642468 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec2064-2d77-4207-ab97-c9868322b543 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:48.643363 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 165/337] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:48.645047 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 173/338] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:48.648975 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a470846-8861-47e0-9d88-380bb5615b0a None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:48.652033 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a470846-8861-47e0-9d88-380bb5615b0a None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:48.652033 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a470846-8861-47e0-9d88-380bb5615b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:48.654519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242280d6-4bb5-40b1-8d01-f7e4bca75bc9 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:48.655887 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242280d6-4bb5-40b1-8d01-f7e4bca75bc9 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:48.656782 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242280d6-4bb5-40b1-8d01-f7e4bca75bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:48.679530 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-5a470846-8861-47e0-9d88-380bb5615b0a None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:48.679530 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-5a470846-8861-47e0-9d88-380bb5615b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:48.711450 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-242280d6-4bb5-40b1-8d01-f7e4bca75bc9 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:48.719028 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-242280d6-4bb5-40b1-8d01-f7e4bca75bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:48.853808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 166/339] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:28:48.916639 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 174/340] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:49.406271 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a470846-8861-47e0-9d88-380bb5615b0a None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:49.443056 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:49.536327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242280d6-4bb5-40b1-8d01-f7e4bca75bc9 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:49.554595 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a470846-8861-47e0-9d88-380bb5615b0a None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:49.632282 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:49.661937 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57b6b6-b419-465b-8476-b2350f31ae52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:49.661937 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57b6b6-b419-465b-8476-b2350f31ae52 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:49.661937 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57b6b6-b419-465b-8476-b2350f31ae52 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:49.661937 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57b6b6-b419-465b-8476-b2350f31ae52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:49.680650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57b6b6-b419-465b-8476-b2350f31ae52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:49.685813 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-6f57b6b6-b419-465b-8476-b2350f31ae52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:49.685813 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:49.685813 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:49.685813 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:49.685813 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:49.685813 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:49.685813 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:49.685813 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:49.685813 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:49.685813 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:49.685813 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:49.685813 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:49.685813 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:49.685813 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:49.685813 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:49.685813 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:49.688181 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:49.688181 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:49.688181 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:49.688181 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:49.688181 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:49.688181 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:49.688181 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:49.688181 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:49.688181 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:49.688181 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:49.688181 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:49.688181 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:49.688181 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:49.688181 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:49.688181 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:49.688181 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:49.689504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:49.689504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:49.689504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:49.689504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:49.689504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:49.689504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:49.689504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:49.689504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:49.689504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:49.689504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:49.689504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:49.689504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:49.689504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 167/341] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:28:49.689504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9847339-5a62-4770-8cc5-a11fb77ec85a None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:49.692425 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9847339-5a62-4770-8cc5-a11fb77ec85a None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:49.692425 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9847339-5a62-4770-8cc5-a11fb77ec85a None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:49.692425 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 168/342] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:49.701034 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46afb2-a6a7-4f1a-838d-faf3a04c4916 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:49.701444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46afb2-a6a7-4f1a-838d-faf3a04c4916 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:49.701679 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46afb2-a6a7-4f1a-838d-faf3a04c4916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:49.733102 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242280d6-4bb5-40b1-8d01-f7e4bca75bc9 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:49.749293 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-8a46afb2-a6a7-4f1a-838d-faf3a04c4916 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:49.750507 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-8a46afb2-a6a7-4f1a-838d-faf3a04c4916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:49.772793 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3aeb5-4ff3-479c-97ab-d910564b3aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:49.773453 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3aeb5-4ff3-479c-97ab-d910564b3aa8 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:49.773735 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3aeb5-4ff3-479c-97ab-d910564b3aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:49.774012 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3aeb5-4ff3-479c-97ab-d910564b3aa8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:49.786163 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3aeb5-4ff3-479c-97ab-d910564b3aa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:49.791105 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-dbf3aeb5-4ff3-479c-97ab-d910564b3aa8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:49.791105 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:49.791105 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:49.791105 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:49.791105 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:49.791105 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:49.791105 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:49.791105 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:49.791105 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:49.791105 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:49.791105 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:49.791105 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:49.791105 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:49.791105 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:49.791105 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:49.791105 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:49.792766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:49.792766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:49.792766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:49.792766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:49.792766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:49.792766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:49.792766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:49.792766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:49.792766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:49.792766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:49.792766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:49.792766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:49.792766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:49.792766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:49.792766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:49.792766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:49.794952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:49.794952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:49.794952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:49.794952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:49.794952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:49.794952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:49.794952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:49.794952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:49.794952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:49.794952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:49.794952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:49.794952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:28:49.794952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 175/343] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:49.799666 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3aeb5-4ff3-479c-97ab-d910564b3aa8 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:49.902137 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 169/344] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:49.904465 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46afb2-a6a7-4f1a-838d-faf3a04c4916 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:49.938332 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3aeb5-4ff3-479c-97ab-d910564b3aa8 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:49.940352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:49.947399 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:50.052993 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c541570-9b33-4df3-8a47-33d6d19bfcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:50.053241 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c541570-9b33-4df3-8a47-33d6d19bfcce None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:50.053318 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c541570-9b33-4df3-8a47-33d6d19bfcce None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:50.053565 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c541570-9b33-4df3-8a47-33d6d19bfcce None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:50.054285 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c541570-9b33-4df3-8a47-33d6d19bfcce None admin] RBAC: Adding query filter params (name=member) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:50.054584 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c541570-9b33-4df3-8a47-33d6d19bfcce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:50.056061 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c541570-9b33-4df3-8a47-33d6d19bfcce None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:50.083380 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 176/345] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:50.085291 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c541570-9b33-4df3-8a47-33d6d19bfcce None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:50.109009 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46afb2-a6a7-4f1a-838d-faf3a04c4916 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:50.151263 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8b57c-7947-4996-9bb7-89244ee1eab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:50.152547 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8b57c-7947-4996-9bb7-89244ee1eab0 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:50.153800 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8b57c-7947-4996-9bb7-89244ee1eab0 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:50.154111 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8b57c-7947-4996-9bb7-89244ee1eab0 None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:50.154784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8b57c-7947-4996-9bb7-89244ee1eab0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:50.155153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8b57c-7947-4996-9bb7-89244ee1eab0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:50.156767 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8b57c-7947-4996-9bb7-89244ee1eab0 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:50.168119 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 170/346] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:50.169548 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d3f67-60a1-4c0f-b725-68930ec0d796 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:50.169863 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d3f67-60a1-4c0f-b725-68930ec0d796 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:50.170119 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d3f67-60a1-4c0f-b725-68930ec0d796 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:50.171767 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 171/347] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:50.173153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d3f67-60a1-4c0f-b725-68930ec0d796 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:50.281836 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c541570-9b33-4df3-8a47-33d6d19bfcce None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:50.320743 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:50.359586 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d3f67-60a1-4c0f-b725-68930ec0d796 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:50.367539 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257dc73a-b0e7-4101-b2ea-4365cf9fc99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:50.369867 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dc73a-b0e7-4101-b2ea-4365cf9fc99f None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:50.370475 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dc73a-b0e7-4101-b2ea-4365cf9fc99f None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:50.371060 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dc73a-b0e7-4101-b2ea-4365cf9fc99f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:50.387919 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257dc73a-b0e7-4101-b2ea-4365cf9fc99f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:50.393917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-257dc73a-b0e7-4101-b2ea-4365cf9fc99f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:28:50.393917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:50.393917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:50.393917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:50.393917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:50.393917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:50.393917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:50.393917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:50.393917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:50.393917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:50.393917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:50.393917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:50.393917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:50.393917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:50.393917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:50.393917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:50.395125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:50.395125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:50.395125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:50.395125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:50.395125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:50.395125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:50.395125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:50.395125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:50.395125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:50.395125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:50.395125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:50.395125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:50.395125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:50.395125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:50.395125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:50.395125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:50.396261 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:50.396261 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:50.396261 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:50.396261 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:50.396261 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:50.396261 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:50.396261 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:50.396261 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:50.396261 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:50.396261 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:50.396261 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:28:50.396261 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:28:50.398488 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 177/348] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 20:28:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:50.399364 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257dc73a-b0e7-4101-b2ea-4365cf9fc99f None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:50.428242 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698305a-e9da-4f87-908d-26c7c3fa5061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:50.429088 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698305a-e9da-4f87-908d-26c7c3fa5061 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:50.429253 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698305a-e9da-4f87-908d-26c7c3fa5061 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:50.429525 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698305a-e9da-4f87-908d-26c7c3fa5061 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:50.449939 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:50.544900 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698305a-e9da-4f87-908d-26c7c3fa5061 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:50.546994 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698305a-e9da-4f87-908d-26c7c3fa5061 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:50.622392 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257dc73a-b0e7-4101-b2ea-4365cf9fc99f None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:50.651935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:50.689411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 172/349] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:28:50.692180 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29992adf-6b89-4753-83b7-fbf19f458f50 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:50.692884 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29992adf-6b89-4753-83b7-fbf19f458f50 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:50.693917 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29992adf-6b89-4753-83b7-fbf19f458f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:50.701481 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56089caf-9224-4119-bb29-f3eda0ec4d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:50.702584 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56089caf-9224-4119-bb29-f3eda0ec4d96 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:50.702917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56089caf-9224-4119-bb29-f3eda0ec4d96 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:50.703171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56089caf-9224-4119-bb29-f3eda0ec4d96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:50.727340 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-29992adf-6b89-4753-83b7-fbf19f458f50 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:50.728908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-29992adf-6b89-4753-83b7-fbf19f458f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:50.820217 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56089caf-9224-4119-bb29-f3eda0ec4d96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:50.822334 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56089caf-9224-4119-bb29-f3eda0ec4d96 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:50.837392 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 173/350] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:50.838973 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29992adf-6b89-4753-83b7-fbf19f458f50 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:50.877757 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:51.006343 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29992adf-6b89-4753-83b7-fbf19f458f50 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:51.020022 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:51.032699 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 178/351] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:28:51.034524 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56089caf-9224-4119-bb29-f3eda0ec4d96 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:51.047256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b255aef-5667-40ea-bfa1-66951287dcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:51.047942 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b255aef-5667-40ea-bfa1-66951287dcf2 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:51.048222 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b255aef-5667-40ea-bfa1-66951287dcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:51.048494 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b255aef-5667-40ea-bfa1-66951287dcf2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:51.060755 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b255aef-5667-40ea-bfa1-66951287dcf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:51.066627 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-3b255aef-5667-40ea-bfa1-66951287dcf2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:28:51.066627 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:51.066627 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:51.066627 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:51.066627 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:51.066627 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:51.066627 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:51.066627 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:51.066627 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:51.066627 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:51.066627 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:51.066627 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:51.066627 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:51.066627 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:51.066627 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:51.066627 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:51.068422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:51.068422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:51.068422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:51.068422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:51.068422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:51.068422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:51.068422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:51.068422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:51.068422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:51.068422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:51.068422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:51.068422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:51.068422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:51.068422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:51.068422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:51.068422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:51.071305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:51.071305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:51.071305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:51.071305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:51.071305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:51.071305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:51.071305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:51.071305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:51.071305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:51.071305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:51.071305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:28:51.071305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:51.071305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 174/352] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:51.071305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b255aef-5667-40ea-bfa1-66951287dcf2 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:51.210763 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b255aef-5667-40ea-bfa1-66951287dcf2 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:51.231700 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56089caf-9224-4119-bb29-f3eda0ec4d96 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:51.260327 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fcd4e-9754-4a11-8a66-5a90acfd61b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:51.261524 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fcd4e-9754-4a11-8a66-5a90acfd61b4 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:51.262248 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fcd4e-9754-4a11-8a66-5a90acfd61b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:51.262736 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fcd4e-9754-4a11-8a66-5a90acfd61b4 None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:51.265577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fcd4e-9754-4a11-8a66-5a90acfd61b4 None admin] RBAC: Authorizing `identity:get_project(project_id=7bb022d88d4f49bc889242cf22018981)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:51.268572 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fcd4e-9754-4a11-8a66-5a90acfd61b4 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:51.272396 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 175/353] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:51 2022] GET /identity/v3/projects/7bb022d88d4f49bc889242cf22018981 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:51.278440 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fcd4e-9754-4a11-8a66-5a90acfd61b4 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:51.278582 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:51.297099 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0b0ec-4b6b-474f-b141-8d550c0251e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:51.297733 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0b0ec-4b6b-474f-b141-8d550c0251e1 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:51.298024 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0b0ec-4b6b-474f-b141-8d550c0251e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:51.298300 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0b0ec-4b6b-474f-b141-8d550c0251e1 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:51.299008 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0b0ec-4b6b-474f-b141-8d550c0251e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:51.299323 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0b0ec-4b6b-474f-b141-8d550c0251e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:51.300975 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0b0ec-4b6b-474f-b141-8d550c0251e1 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:51.315614 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 179/354] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:28:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:51.315614 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0b0ec-4b6b-474f-b141-8d550c0251e1 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:51.350338 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:51.446970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fcd4e-9754-4a11-8a66-5a90acfd61b4 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:51.496778 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6706a2-50cd-4789-9c5e-3fd5c00fb90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:51.496778 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6706a2-50cd-4789-9c5e-3fd5c00fb90d None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:51.496778 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6706a2-50cd-4789-9c5e-3fd5c00fb90d None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:51.496778 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6706a2-50cd-4789-9c5e-3fd5c00fb90d None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:51.501843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6706a2-50cd-4789-9c5e-3fd5c00fb90d None admin] RBAC: Authorizing `identity:get_project(project_id=45f63f10100747b9b9eaf0e3e8021980)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:51.503170 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6706a2-50cd-4789-9c5e-3fd5c00fb90d None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:51.507705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 176/355] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:51 2022] GET /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:51.510324 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77ed05-8118-445f-978f-32178d98a5b9 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:51.510324 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77ed05-8118-445f-978f-32178d98a5b9 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:51.510729 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77ed05-8118-445f-978f-32178d98a5b9 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:51.513332 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 177/356] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:51.518667 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77ed05-8118-445f-978f-32178d98a5b9 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:51.518871 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0b0ec-4b6b-474f-b141-8d550c0251e1 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:51.563357 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a24e9-72f5-4f3a-8753-fb5a98c1017b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:51.563963 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a24e9-72f5-4f3a-8753-fb5a98c1017b None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:51.564251 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a24e9-72f5-4f3a-8753-fb5a98c1017b None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:51.564523 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a24e9-72f5-4f3a-8753-fb5a98c1017b None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:51.565232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a24e9-72f5-4f3a-8753-fb5a98c1017b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:51.565540 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a24e9-72f5-4f3a-8753-fb5a98c1017b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:51.566999 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a24e9-72f5-4f3a-8753-fb5a98c1017b None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:51.579749 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 180/357] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:51.580679 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a24e9-72f5-4f3a-8753-fb5a98c1017b None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:51.673362 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:51.718480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77ed05-8118-445f-978f-32178d98a5b9 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:51.730158 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:51.754865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a24e9-72f5-4f3a-8753-fb5a98c1017b None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:51.772393 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c6a24-c352-4ed5-b353-c9256d3c469c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:51.773424 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c6a24-c352-4ed5-b353-c9256d3c469c None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:51.773718 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c6a24-c352-4ed5-b353-c9256d3c469c None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:51.773992 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c6a24-c352-4ed5-b353-c9256d3c469c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:51.789085 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c6a24-c352-4ed5-b353-c9256d3c469c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:51.797012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-ed3c6a24-c352-4ed5-b353-c9256d3c469c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:28:51.797012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:51.797012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:51.797012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:51.797012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:51.797012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:51.797012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:51.797012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:51.797012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:51.797012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:51.797012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:51.797012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:51.797012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:51.797012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:51.797012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:51.797012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:51.797977 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:51.797977 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:51.797977 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:51.797977 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:51.797977 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:51.797977 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:51.797977 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:51.797977 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:51.797977 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:51.797977 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:51.797977 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:51.797977 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:51.797977 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:51.797977 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:51.797977 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:51.797977 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:51.798789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:51.798789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:51.798789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:51.798789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:51.798789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:51.798789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:51.798789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:51.798789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:51.798789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:51.798789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:51.798789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:28:51.798789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:51.799407 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 178/358] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 20:28:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:51.800263 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c6a24-c352-4ed5-b353-c9256d3c469c None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:51.822325 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabca07-3696-4e82-9efc-18d13d6a7769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:51.823195 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabca07-3696-4e82-9efc-18d13d6a7769 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:51.824594 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabca07-3696-4e82-9efc-18d13d6a7769 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:51.824594 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabca07-3696-4e82-9efc-18d13d6a7769 None admin] PATH_INFO: `/v3/groups/e386b3b088094609bd1c524d30752a9f` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:51.835188 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabca07-3696-4e82-9efc-18d13d6a7769 None admin] RBAC: Authorizing `identity:get_group(group_id=e386b3b088094609bd1c524d30752a9f)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:51.838032 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabca07-3696-4e82-9efc-18d13d6a7769 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:51.847586 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 181/359] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 20:28:51 2022] GET /identity/v3/groups/e386b3b088094609bd1c524d30752a9f => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:51.847586 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabca07-3696-4e82-9efc-18d13d6a7769 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:51.972582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c6a24-c352-4ed5-b353-c9256d3c469c None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:52.023790 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabca07-3696-4e82-9efc-18d13d6a7769 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:52.033521 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa5c50-168c-4ab2-8fbf-49be71c56ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:52.034160 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa5c50-168c-4ab2-8fbf-49be71c56ebe None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:52.034439 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa5c50-168c-4ab2-8fbf-49be71c56ebe None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:52.034783 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa5c50-168c-4ab2-8fbf-49be71c56ebe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:52.060304 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:52.087123 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:52.104364 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6f0be-f985-4bd9-aa8d-5e40e097f5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:52.105434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6f0be-f985-4bd9-aa8d-5e40e097f5fa None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:52.105933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6f0be-f985-4bd9-aa8d-5e40e097f5fa None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:52.106417 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6f0be-f985-4bd9-aa8d-5e40e097f5fa None admin] PATH_INFO: `/v3/groups/e386b3b088094609bd1c524d30752a9f` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:52.109093 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6f0be-f985-4bd9-aa8d-5e40e097f5fa None admin] RBAC: Authorizing `identity:get_group(group_id=e386b3b088094609bd1c524d30752a9f)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:52.111950 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6f0be-f985-4bd9-aa8d-5e40e097f5fa None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:52.115398 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 182/360] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 20:28:51 2022] GET /identity/v3/groups/e386b3b088094609bd1c524d30752a9f => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:52.124873 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bfa61-4f6b-4a9c-a124-2470c46eb2f4 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:52.127817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bfa61-4f6b-4a9c-a124-2470c46eb2f4 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:52.127817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bfa61-4f6b-4a9c-a124-2470c46eb2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:52.151132 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa5c50-168c-4ab2-8fbf-49be71c56ebe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:52.151910 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-d42bfa61-4f6b-4a9c-a124-2470c46eb2f4 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:52.152697 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa5c50-168c-4ab2-8fbf-49be71c56ebe None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:52.153512 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-d42bfa61-4f6b-4a9c-a124-2470c46eb2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:52.279348 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 183/361] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:52.280200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bfa61-4f6b-4a9c-a124-2470c46eb2f4 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:52.315820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 179/362] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:28:52.317308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa5c50-168c-4ab2-8fbf-49be71c56ebe None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:52.437131 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:52.456821 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bfa61-4f6b-4a9c-a124-2470c46eb2f4 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:52.476964 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:52.504129 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa5c50-168c-4ab2-8fbf-49be71c56ebe None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:52.513739 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a380f-b903-4d4e-8fb3-8b5f5de9fddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:52.515589 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a380f-b903-4d4e-8fb3-8b5f5de9fddf None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:52.516051 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a380f-b903-4d4e-8fb3-8b5f5de9fddf None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:52.516536 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a380f-b903-4d4e-8fb3-8b5f5de9fddf None admin] PATH_INFO: `/v3/users/e4145486082843feb6d5dc658c05db21` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:52.518622 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a380f-b903-4d4e-8fb3-8b5f5de9fddf None admin] RBAC: Authorizing `identity:get_user(user_id=e4145486082843feb6d5dc658c05db21)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:52.521588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a380f-b903-4d4e-8fb3-8b5f5de9fddf None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:52.527327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 184/363] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:52 2022] GET /identity/v3/users/e4145486082843feb6d5dc658c05db21 => generated 293 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:52.527327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a380f-b903-4d4e-8fb3-8b5f5de9fddf None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:52.571369 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320845e0-dcb0-4401-af1d-cf25410b3b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:52.572561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320845e0-dcb0-4401-af1d-cf25410b3b7b None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:52.573062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320845e0-dcb0-4401-af1d-cf25410b3b7b None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:52.573539 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320845e0-dcb0-4401-af1d-cf25410b3b7b None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:52.574704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320845e0-dcb0-4401-af1d-cf25410b3b7b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:52.575525 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320845e0-dcb0-4401-af1d-cf25410b3b7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:52.578425 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320845e0-dcb0-4401-af1d-cf25410b3b7b None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:52.595597 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 180/364] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:28:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:52.596910 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320845e0-dcb0-4401-af1d-cf25410b3b7b None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:52.701287 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a380f-b903-4d4e-8fb3-8b5f5de9fddf None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:52.741017 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320845e0-dcb0-4401-af1d-cf25410b3b7b None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:52.763498 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35d69c-2416-46a8-83c2-36246231cd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:52.764140 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35d69c-2416-46a8-83c2-36246231cd9c None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:52.764436 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35d69c-2416-46a8-83c2-36246231cd9c None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:52.765185 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35d69c-2416-46a8-83c2-36246231cd9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:52.766021 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35d69c-2416-46a8-83c2-36246231cd9c None admin] RBAC: Adding query filter params (group.id=e386b3b088094609bd1c524d30752a9f, role.id=910e8004690649e3b4fc1c4be76ad967, scope.project.id=7bb022d88d4f49bc889242cf22018981) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:52.766332 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35d69c-2416-46a8-83c2-36246231cd9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:52.767830 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35d69c-2416-46a8-83c2-36246231cd9c None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:52.774398 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 185/365] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Aug 22 20:28:52 2022] GET /identity/v3/role_assignments?group.id=e386b3b088094609bd1c524d30752a9f&scope.project.id=7bb022d88d4f49bc889242cf22018981&role.id=910e8004690649e3b4fc1c4be76ad967 => generated 260 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:52.774945 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35d69c-2416-46a8-83c2-36246231cd9c None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:52.800270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:52.808158 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d23c9-dc27-482b-8379-f270a11fc249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:52.814244 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d23c9-dc27-482b-8379-f270a11fc249 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:52.814244 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d23c9-dc27-482b-8379-f270a11fc249 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:52.814244 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d23c9-dc27-482b-8379-f270a11fc249 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:52.814244 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d23c9-dc27-482b-8379-f270a11fc249 None admin] RBAC: Adding query filter params (group.id=e386b3b088094609bd1c524d30752a9f, role.id=910e8004690649e3b4fc1c4be76ad967, scope.project.id=45f63f10100747b9b9eaf0e3e8021980) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:52.814244 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d23c9-dc27-482b-8379-f270a11fc249 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:52.815890 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d23c9-dc27-482b-8379-f270a11fc249 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:52.831832 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 181/366] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Aug 22 20:28:52 2022] GET /identity/v3/role_assignments?group.id=e386b3b088094609bd1c524d30752a9f&scope.project.id=45f63f10100747b9b9eaf0e3e8021980&role.id=910e8004690649e3b4fc1c4be76ad967 => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:52.835243 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d23c9-dc27-482b-8379-f270a11fc249 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:52.889585 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:52.966384 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35d69c-2416-46a8-83c2-36246231cd9c None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:53.010581 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21cc53-b8e4-4e62-b5c6-98f3c7dee87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:53.011249 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21cc53-b8e4-4e62-b5c6-98f3c7dee87d None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:53.011527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21cc53-b8e4-4e62-b5c6-98f3c7dee87d None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:53.011833 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21cc53-b8e4-4e62-b5c6-98f3c7dee87d None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:53.013121 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21cc53-b8e4-4e62-b5c6-98f3c7dee87d None admin] RBAC: Authorizing `identity:get_project(project_id=7bb022d88d4f49bc889242cf22018981)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:53.015269 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21cc53-b8e4-4e62-b5c6-98f3c7dee87d None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:53.017367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 186/367] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:52 2022] GET /identity/v3/projects/7bb022d88d4f49bc889242cf22018981 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:53.017951 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21cc53-b8e4-4e62-b5c6-98f3c7dee87d None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:53.024030 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d23c9-dc27-482b-8379-f270a11fc249 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:53.099296 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508b207-ecce-4a2e-bfdf-8e5653e528c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:53.099880 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508b207-ecce-4a2e-bfdf-8e5653e528c7 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:53.100187 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508b207-ecce-4a2e-bfdf-8e5653e528c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:53.100447 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508b207-ecce-4a2e-bfdf-8e5653e528c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:53.101422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508b207-ecce-4a2e-bfdf-8e5653e528c7 None admin] RBAC: Adding query filter params (role.id=147cb5e8478b42c0908186e1c2df0e55, user.id=e4145486082843feb6d5dc658c05db21, scope.system=all) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:53.101730 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508b207-ecce-4a2e-bfdf-8e5653e528c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:53.103219 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508b207-ecce-4a2e-bfdf-8e5653e528c7 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:53.123865 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 182/368] 10.222.0.15 () {56 vars in 1308 bytes} [Mon Aug 22 20:28:52 2022] GET /identity/v3/role_assignments?user.id=e4145486082843feb6d5dc658c05db21&scope.system=all&role.id=147cb5e8478b42c0908186e1c2df0e55 => generated 510 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:53.126055 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508b207-ecce-4a2e-bfdf-8e5653e528c7 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:53.207668 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21cc53-b8e4-4e62-b5c6-98f3c7dee87d None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:53.230969 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:53.265729 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:53.297289 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e829331-f098-4a47-b82a-188e304bf042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:53.298285 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e829331-f098-4a47-b82a-188e304bf042 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:53.299944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e829331-f098-4a47-b82a-188e304bf042 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:53.301900 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e829331-f098-4a47-b82a-188e304bf042 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:53.435362 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508b207-ecce-4a2e-bfdf-8e5653e528c7 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:53.479063 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e829331-f098-4a47-b82a-188e304bf042 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:53.481996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e829331-f098-4a47-b82a-188e304bf042 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:53.522863 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89d57c-054f-4321-9fb3-1c463199f30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:53.527859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89d57c-054f-4321-9fb3-1c463199f30a None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:53.528207 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89d57c-054f-4321-9fb3-1c463199f30a None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:53.528476 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89d57c-054f-4321-9fb3-1c463199f30a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:53.560163 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89d57c-054f-4321-9fb3-1c463199f30a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:53.573310 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-7c89d57c-054f-4321-9fb3-1c463199f30a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:53.573310 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:53.573310 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:53.573310 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:53.573310 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:53.573310 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:53.573310 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:53.573310 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:53.573310 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:53.573310 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:53.573310 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:53.573310 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:53.573310 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:53.573310 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:53.573310 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:53.573310 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:53.574297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:53.574297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:53.574297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:53.574297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:53.574297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:53.574297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:53.574297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:53.574297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:53.574297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:53.574297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:53.574297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:53.574297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:53.574297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:53.574297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:53.574297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:53.574297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:53.575098 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:53.575098 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:53.575098 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:53.575098 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:53.575098 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:53.575098 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:53.575098 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:53.575098 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:53.575098 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:53.575098 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:53.575098 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:53.575098 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:53.575098 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 183/369] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 20:28:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 450 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:53.579095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89d57c-054f-4321-9fb3-1c463199f30a None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:53.638723 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 187/370] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:28:53.640612 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e829331-f098-4a47-b82a-188e304bf042 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:53.675602 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:53.796611 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e829331-f098-4a47-b82a-188e304bf042 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:53.829480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89d57c-054f-4321-9fb3-1c463199f30a None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:53.856832 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:53.858198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9974fc-e7fb-4bd8-8d62-e8230066f6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:53.859040 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9974fc-e7fb-4bd8-8d62-e8230066f6db None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:53.859485 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9974fc-e7fb-4bd8-8d62-e8230066f6db None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:53.859924 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9974fc-e7fb-4bd8-8d62-e8230066f6db None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:53.860741 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9974fc-e7fb-4bd8-8d62-e8230066f6db None admin] RBAC: Adding query filter params (name=admin) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:53.861160 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9974fc-e7fb-4bd8-8d62-e8230066f6db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:53.863628 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9974fc-e7fb-4bd8-8d62-e8230066f6db None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:53.882299 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 188/371] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:53.883281 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9974fc-e7fb-4bd8-8d62-e8230066f6db None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:53.904366 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f49251-748c-41bd-bb03-0a2c6a678f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:53.907650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f49251-748c-41bd-bb03-0a2c6a678f4c None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:53.908672 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f49251-748c-41bd-bb03-0a2c6a678f4c None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:53.909540 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f49251-748c-41bd-bb03-0a2c6a678f4c None admin] PATH_INFO: `/v3/groups/e386b3b088094609bd1c524d30752a9f` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:53.917095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f49251-748c-41bd-bb03-0a2c6a678f4c None admin] RBAC: Authorizing `identity:get_group(group_id=e386b3b088094609bd1c524d30752a9f)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:53.920359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f49251-748c-41bd-bb03-0a2c6a678f4c None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:53.924029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 184/372] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 20:28:53 2022] GET /identity/v3/groups/e386b3b088094609bd1c524d30752a9f => generated 226 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:53.925816 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f49251-748c-41bd-bb03-0a2c6a678f4c None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:54.030087 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:54.072849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9974fc-e7fb-4bd8-8d62-e8230066f6db None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:54.125810 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f49251-748c-41bd-bb03-0a2c6a678f4c None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:54.139104 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e3749-e04c-4ee3-9f81-7236159351c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:54.141141 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e3749-e04c-4ee3-9f81-7236159351c2 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:54.141621 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e3749-e04c-4ee3-9f81-7236159351c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:54.142071 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e3749-e04c-4ee3-9f81-7236159351c2 None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:54.144196 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e3749-e04c-4ee3-9f81-7236159351c2 None admin] RBAC: Authorizing `identity:get_project(project_id=45f63f10100747b9b9eaf0e3e8021980)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:54.146896 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e3749-e04c-4ee3-9f81-7236159351c2 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:54.151428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 189/373] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:53 2022] GET /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:54.154196 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e3749-e04c-4ee3-9f81-7236159351c2 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:54.182082 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae897b8-0e0e-4ea7-963a-3f45dd7f483d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:54.183480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae897b8-0e0e-4ea7-963a-3f45dd7f483d None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:54.184004 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae897b8-0e0e-4ea7-963a-3f45dd7f483d None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:54.184847 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae897b8-0e0e-4ea7-963a-3f45dd7f483d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:54.299652 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:54.312998 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e3749-e04c-4ee3-9f81-7236159351c2 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:54.350531 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae897b8-0e0e-4ea7-963a-3f45dd7f483d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:54.354668 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae897b8-0e0e-4ea7-963a-3f45dd7f483d None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:54.359476 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512884da-af4b-4788-a985-63c658926377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:54.360463 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512884da-af4b-4788-a985-63c658926377 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:54.360942 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512884da-af4b-4788-a985-63c658926377 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:54.361470 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512884da-af4b-4788-a985-63c658926377 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:54.362416 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512884da-af4b-4788-a985-63c658926377 None admin] RBAC: Adding query filter params (group.id=e386b3b088094609bd1c524d30752a9f, role.id=fcd9a48e6c4b4c048380a57be435c3dd, scope.project.id=7bb022d88d4f49bc889242cf22018981) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:54.362941 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512884da-af4b-4788-a985-63c658926377 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:54.369515 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512884da-af4b-4788-a985-63c658926377 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:54.377781 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 190/374] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Aug 22 20:28:54 2022] GET /identity/v3/role_assignments?group.id=e386b3b088094609bd1c524d30752a9f&scope.project.id=7bb022d88d4f49bc889242cf22018981&role.id=fcd9a48e6c4b4c048380a57be435c3dd => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:54.378932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512884da-af4b-4788-a985-63c658926377 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:54.386635 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:54.533955 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 185/375] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:28:54.542352 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae897b8-0e0e-4ea7-963a-3f45dd7f483d None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:54.596206 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512884da-af4b-4788-a985-63c658926377 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:54.671564 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef4a7f-a6a4-4742-90de-ca245242e90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:54.672696 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef4a7f-a6a4-4742-90de-ca245242e90f None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:54.673236 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef4a7f-a6a4-4742-90de-ca245242e90f None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:54.673861 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef4a7f-a6a4-4742-90de-ca245242e90f None admin] PATH_INFO: `/v3/groups/e386b3b088094609bd1c524d30752a9f` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:54.675595 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef4a7f-a6a4-4742-90de-ca245242e90f None admin] RBAC: Authorizing `identity:get_group(group_id=e386b3b088094609bd1c524d30752a9f)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:54.677367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef4a7f-a6a4-4742-90de-ca245242e90f None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:54.684085 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 191/376] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 20:28:54 2022] GET /identity/v3/groups/e386b3b088094609bd1c524d30752a9f => generated 226 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:54.686827 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef4a7f-a6a4-4742-90de-ca245242e90f None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:54.724698 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:54.779579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae897b8-0e0e-4ea7-963a-3f45dd7f483d None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:54.795193 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:54.820523 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fc728-a914-4123-b478-256703781606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:54.821181 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fc728-a914-4123-b478-256703781606 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:54.821460 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fc728-a914-4123-b478-256703781606 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:54.821728 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fc728-a914-4123-b478-256703781606 None admin] PATH_INFO: `/v3/projects/41d17f0c019c419fa2ba2277c76a76b5` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:54.826828 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fc728-a914-4123-b478-256703781606 None admin] RBAC: Authorizing `identity:get_project(project_id=41d17f0c019c419fa2ba2277c76a76b5)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:54.830075 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fc728-a914-4123-b478-256703781606 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:54.831910 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 186/377] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:54 2022] GET /identity/v3/projects/41d17f0c019c419fa2ba2277c76a76b5 => generated 344 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:54.838728 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fc728-a914-4123-b478-256703781606 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:54.856065 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef4a7f-a6a4-4742-90de-ca245242e90f None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:54.934974 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfdfe8-1505-49a0-96f2-0d21e37fcefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:54.935531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfdfe8-1505-49a0-96f2-0d21e37fcefb None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:54.935830 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfdfe8-1505-49a0-96f2-0d21e37fcefb None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:54.936108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfdfe8-1505-49a0-96f2-0d21e37fcefb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:54.936895 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfdfe8-1505-49a0-96f2-0d21e37fcefb None admin] RBAC: Adding query filter params (group.id=e386b3b088094609bd1c524d30752a9f, role.id=fcd9a48e6c4b4c048380a57be435c3dd, scope.project.id=45f63f10100747b9b9eaf0e3e8021980) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:54.937208 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfdfe8-1505-49a0-96f2-0d21e37fcefb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:54.938703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfdfe8-1505-49a0-96f2-0d21e37fcefb None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:54.945330 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 192/378] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Aug 22 20:28:54 2022] GET /identity/v3/role_assignments?group.id=e386b3b088094609bd1c524d30752a9f&scope.project.id=45f63f10100747b9b9eaf0e3e8021980&role.id=fcd9a48e6c4b4c048380a57be435c3dd => generated 260 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:55.055119 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fc728-a914-4123-b478-256703781606 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:55.105444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28809c-249e-4c24-8167-aef5ceadda00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:55.106103 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28809c-249e-4c24-8167-aef5ceadda00 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:55.106389 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28809c-249e-4c24-8167-aef5ceadda00 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:55.106666 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28809c-249e-4c24-8167-aef5ceadda00 None admin] PATH_INFO: `/v3/groups/73f34a58e16c4627aba449239ba3847c` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:55.116411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28809c-249e-4c24-8167-aef5ceadda00 None admin] RBAC: Authorizing `identity:get_group(group_id=73f34a58e16c4627aba449239ba3847c)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:55.118313 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28809c-249e-4c24-8167-aef5ceadda00 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:55.120745 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 187/379] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 20:28:54 2022] GET /identity/v3/groups/73f34a58e16c4627aba449239ba3847c => generated 229 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:55.127173 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfdfe8-1505-49a0-96f2-0d21e37fcefb None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:55.291387 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfdfe8-1505-49a0-96f2-0d21e37fcefb None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:55.346917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c65a8b-84b3-4b17-862b-7e4d1af065c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:55.347576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c65a8b-84b3-4b17-862b-7e4d1af065c2 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:55.347861 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c65a8b-84b3-4b17-862b-7e4d1af065c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:55.348137 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c65a8b-84b3-4b17-862b-7e4d1af065c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:55.348907 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c65a8b-84b3-4b17-862b-7e4d1af065c2 None admin] RBAC: Adding query filter params (group.id=73f34a58e16c4627aba449239ba3847c, role.id=1e3ce9c8b9934a7bb515b39e21fc1d68, scope.project.id=41d17f0c019c419fa2ba2277c76a76b5) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:55.349222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c65a8b-84b3-4b17-862b-7e4d1af065c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:55.350808 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c65a8b-84b3-4b17-862b-7e4d1af065c2 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:55.361602 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 193/380] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Aug 22 20:28:55 2022] GET /identity/v3/role_assignments?group.id=73f34a58e16c4627aba449239ba3847c&scope.project.id=41d17f0c019c419fa2ba2277c76a76b5&role.id=1e3ce9c8b9934a7bb515b39e21fc1d68 => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:55.362262 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:55.818304 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b80ba3-74be-408e-a290-d34cd707d424 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:55.818864 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b80ba3-74be-408e-a290-d34cd707d424 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:55.818864 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b80ba3-74be-408e-a290-d34cd707d424 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:55.820576 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 188/381] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:55.826163 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e6529-60ac-4710-895d-2ca0f98e1c61 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:55.826493 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e6529-60ac-4710-895d-2ca0f98e1c61 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:55.826805 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e6529-60ac-4710-895d-2ca0f98e1c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:55.852767 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-fc4e6529-60ac-4710-895d-2ca0f98e1c61 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:55.854278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-fc4e6529-60ac-4710-895d-2ca0f98e1c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:55.955091 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 194/382] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:56.360402 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b80ba3-74be-408e-a290-d34cd707d424 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:56.387272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:56.625457 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b80ba3-74be-408e-a290-d34cd707d424 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:56.674784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d502e8b-a83e-4753-ab78-19f0d1dbf5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:56.675494 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d502e8b-a83e-4753-ab78-19f0d1dbf5f0 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:56.675813 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d502e8b-a83e-4753-ab78-19f0d1dbf5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:56.676092 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d502e8b-a83e-4753-ab78-19f0d1dbf5f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:56.694200 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d502e8b-a83e-4753-ab78-19f0d1dbf5f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:56.699057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-2d502e8b-a83e-4753-ab78-19f0d1dbf5f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:56.699057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:56.699057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:56.699057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:56.699057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:56.699057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:56.699057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:56.699057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:56.699057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:56.699057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:56.699057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:56.699057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:56.699057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:56.699057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:56.699057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:56.699057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:56.700730 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:56.700730 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:56.700730 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:56.700730 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:56.700730 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:56.700730 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:56.700730 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:56.700730 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:56.700730 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:56.700730 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:56.700730 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:56.700730 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:56.700730 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:56.700730 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:56.700730 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:56.700730 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:56.702297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:56.702297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:56.702297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:56.702297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:56.702297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:56.702297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:56.702297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:56.702297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:56.702297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:56.702297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:56.702297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:56.702297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:56.702297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 189/383] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:56.706680 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e6529-60ac-4710-895d-2ca0f98e1c61 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:56.738118 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78618a33-6fb7-4f0c-aed4-af3638969056 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:56.738516 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78618a33-6fb7-4f0c-aed4-af3638969056 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:56.738751 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78618a33-6fb7-4f0c-aed4-af3638969056 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:56.740300 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 190/384] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:56.745903 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d71fce-ebd1-47e6-b7b4-c4376ceb92e8 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:56.746191 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d71fce-ebd1-47e6-b7b4-c4376ceb92e8 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:56.746462 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d71fce-ebd1-47e6-b7b4-c4376ceb92e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:56.777398 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-12d71fce-ebd1-47e6-b7b4-c4376ceb92e8 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:56.783493 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-12d71fce-ebd1-47e6-b7b4-c4376ceb92e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:56.891997 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:56.907724 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 191/385] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:28:56.917506 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e6529-60ac-4710-895d-2ca0f98e1c61 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:56.980821 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:56.991898 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b841839-7c1c-4eff-b199-4fbbe4aa4023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:56.992936 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b841839-7c1c-4eff-b199-4fbbe4aa4023 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:56.993395 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b841839-7c1c-4eff-b199-4fbbe4aa4023 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:56.993873 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b841839-7c1c-4eff-b199-4fbbe4aa4023 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:56.995054 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b841839-7c1c-4eff-b199-4fbbe4aa4023 None admin] RBAC: Adding query filter params (name=member) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:56.995580 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b841839-7c1c-4eff-b199-4fbbe4aa4023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:56.998202 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b841839-7c1c-4eff-b199-4fbbe4aa4023 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:57.016221 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 195/386] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:57.022025 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d71fce-ebd1-47e6-b7b4-c4376ceb92e8 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:57.243739 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be2739-a9e7-4e98-abfd-273ea05cfd96 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:57.244409 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be2739-a9e7-4e98-abfd-273ea05cfd96 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:57.244902 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be2739-a9e7-4e98-abfd-273ea05cfd96 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:57.246764 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 196/387] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:28:57.252849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f637518-4087-49a8-acd6-127d11f1f7d1 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:57.253442 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f637518-4087-49a8-acd6-127d11f1f7d1 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:57.253934 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f637518-4087-49a8-acd6-127d11f1f7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:57.254673 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d71fce-ebd1-47e6-b7b4-c4376ceb92e8 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:57.288447 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-3f637518-4087-49a8-acd6-127d11f1f7d1 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:57.290169 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-3f637518-4087-49a8-acd6-127d11f1f7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:57.324195 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd51b84-c3aa-438f-955e-0b883c8caa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:57.325504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd51b84-c3aa-438f-955e-0b883c8caa9d None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:57.327041 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd51b84-c3aa-438f-955e-0b883c8caa9d None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:57.327580 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd51b84-c3aa-438f-955e-0b883c8caa9d None admin] PATH_INFO: `/v3/groups/e386b3b088094609bd1c524d30752a9f` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:57.329908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd51b84-c3aa-438f-955e-0b883c8caa9d None admin] RBAC: Authorizing `identity:get_group(group_id=e386b3b088094609bd1c524d30752a9f)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:57.334760 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd51b84-c3aa-438f-955e-0b883c8caa9d None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:57.338735 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 192/388] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 20:28:57 2022] GET /identity/v3/groups/e386b3b088094609bd1c524d30752a9f => generated 226 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:57.344589 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd51b84-c3aa-438f-955e-0b883c8caa9d None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:57.446240 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:57.451490 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 197/389] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:28:57.509855 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd51b84-c3aa-438f-955e-0b883c8caa9d None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:57.549322 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05349e-9aa4-4bed-b981-d73d156329e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:57.550256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05349e-9aa4-4bed-b981-d73d156329e9 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:57.550743 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05349e-9aa4-4bed-b981-d73d156329e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:57.551225 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05349e-9aa4-4bed-b981-d73d156329e9 None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:57.552646 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05349e-9aa4-4bed-b981-d73d156329e9 None admin] RBAC: Authorizing `identity:get_project(project_id=7bb022d88d4f49bc889242cf22018981)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:57.554431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05349e-9aa4-4bed-b981-d73d156329e9 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:57.556673 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 193/390] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:57 2022] GET /identity/v3/projects/7bb022d88d4f49bc889242cf22018981 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:57.565090 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f637518-4087-49a8-acd6-127d11f1f7d1 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:57.661879 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05349e-9aa4-4bed-b981-d73d156329e9 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:57.855715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f637518-4087-49a8-acd6-127d11f1f7d1 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:57.893358 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:57.917258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405d8e9-fdd7-42ce-9948-8b93cf2944cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:57.917801 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405d8e9-fdd7-42ce-9948-8b93cf2944cd None admin] REQUEST_METHOD: `PUT` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:57.918080 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405d8e9-fdd7-42ce-9948-8b93cf2944cd None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:57.918527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405d8e9-fdd7-42ce-9948-8b93cf2944cd None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981/groups/e386b3b088094609bd1c524d30752a9f/roles/910e8004690649e3b4fc1c4be76ad967` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:57.921572 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405d8e9-fdd7-42ce-9948-8b93cf2944cd None admin] RBAC: Authorizing `identity:create_grant(project_id=7bb022d88d4f49bc889242cf22018981, group_id=e386b3b088094609bd1c524d30752a9f, role_id=910e8004690649e3b4fc1c4be76ad967)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:57.923292 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405d8e9-fdd7-42ce-9948-8b93cf2944cd None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:57.945417 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05349e-9aa4-4bed-b981-d73d156329e9 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:58.010658 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c3798-d079-47cb-8a74-ccaea8f53b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:58.011756 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c3798-d079-47cb-8a74-ccaea8f53b64 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:58.018185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c3798-d079-47cb-8a74-ccaea8f53b64 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:58.018185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c3798-d079-47cb-8a74-ccaea8f53b64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:58.018478 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 198/391] 10.222.0.15 () {58 vars in 1442 bytes} [Mon Aug 22 20:28:57 2022] PUT /identity/v3/projects/7bb022d88d4f49bc889242cf22018981/groups/e386b3b088094609bd1c524d30752a9f/roles/910e8004690649e3b4fc1c4be76ad967 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:28:58.020903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405d8e9-fdd7-42ce-9948-8b93cf2944cd None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:58.025921 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:58.064672 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c3798-d079-47cb-8a74-ccaea8f53b64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:58.082228 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-019c3798-d079-47cb-8a74-ccaea8f53b64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:58.082228 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:58.082228 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:58.082228 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:58.082228 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:58.082228 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:58.082228 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:58.082228 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:58.082228 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:58.082228 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:58.082228 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:58.082228 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:58.082228 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:58.082228 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:58.082228 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:58.082228 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:58.083204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:58.083204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:58.083204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:58.083204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:58.083204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:58.083204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:58.083204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:58.083204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:58.083204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:58.083204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:58.083204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:58.083204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:58.083204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:58.083204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:58.083204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:58.083204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:58.084417 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:58.084417 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:58.084417 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:58.084417 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:58.084417 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:58.084417 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:58.084417 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:58.084417 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:58.084417 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:58.084417 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:58.084417 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:28:58.084417 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:28:58.085029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 194/392] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 423 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:28:58.094856 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c3798-d079-47cb-8a74-ccaea8f53b64 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:58.187623 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405d8e9-fdd7-42ce-9948-8b93cf2944cd None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:58.236607 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab4e3a-a2d5-48dd-b936-1c9c2df66a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:58.239000 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab4e3a-a2d5-48dd-b936-1c9c2df66a39 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:58.241928 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab4e3a-a2d5-48dd-b936-1c9c2df66a39 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:58.242507 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab4e3a-a2d5-48dd-b936-1c9c2df66a39 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:58.273952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab4e3a-a2d5-48dd-b936-1c9c2df66a39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:58.280434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-b5ab4e3a-a2d5-48dd-b936-1c9c2df66a39 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:28:58.280434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:58.280434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:58.280434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:58.280434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:58.280434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:58.280434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:58.280434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:58.280434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:58.280434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:58.280434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:58.280434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:58.280434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:58.280434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:58.280434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:58.280434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:58.281397 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:58.281397 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:58.281397 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:58.281397 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:58.281397 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:58.281397 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:58.281397 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:58.281397 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:58.281397 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:58.281397 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:58.281397 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:58.281397 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:58.281397 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:58.281397 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:58.281397 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:58.281397 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:58.282223 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:58.282223 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:58.282223 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:58.282223 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:58.282223 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:58.282223 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:58.282223 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:58.282223 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:58.282223 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:58.282223 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:58.282223 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:28:58.282223 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:28:58.289831 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 199/393] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 20:28:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:58.298356 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab4e3a-a2d5-48dd-b936-1c9c2df66a39 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:58.423971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:58.427109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c3798-d079-47cb-8a74-ccaea8f53b64 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:58.515991 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a026b7-1c65-4e45-95bc-a02fd3b7607b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:58.516518 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a026b7-1c65-4e45-95bc-a02fd3b7607b None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:58.516801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a026b7-1c65-4e45-95bc-a02fd3b7607b None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:58.517073 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a026b7-1c65-4e45-95bc-a02fd3b7607b None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:58.522634 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a026b7-1c65-4e45-95bc-a02fd3b7607b None admin] RBAC: Adding query filter params (name=member) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:58.523000 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a026b7-1c65-4e45-95bc-a02fd3b7607b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:58.529649 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a026b7-1c65-4e45-95bc-a02fd3b7607b None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:58.555582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 195/394] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:28:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:58.555833 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab4e3a-a2d5-48dd-b936-1c9c2df66a39 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:58.555971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a026b7-1c65-4e45-95bc-a02fd3b7607b None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:58.626846 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16f0b6-f0ce-46b2-ba35-b877db37b71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:58.627693 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16f0b6-f0ce-46b2-ba35-b877db37b71d None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:58.627981 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16f0b6-f0ce-46b2-ba35-b877db37b71d None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:58.628261 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16f0b6-f0ce-46b2-ba35-b877db37b71d None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:58.628968 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16f0b6-f0ce-46b2-ba35-b877db37b71d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:58.629274 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16f0b6-f0ce-46b2-ba35-b877db37b71d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:58.630866 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16f0b6-f0ce-46b2-ba35-b877db37b71d None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:58.641305 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 200/395] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:28:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:58.642457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fe67b-8119-41e7-8cf7-125d33cc7823 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:58.642746 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fe67b-8119-41e7-8cf7-125d33cc7823 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:58.643023 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fe67b-8119-41e7-8cf7-125d33cc7823 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:58.649458 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 201/396] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:58.650306 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fe67b-8119-41e7-8cf7-125d33cc7823 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:58.659966 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:58.708802 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a026b7-1c65-4e45-95bc-a02fd3b7607b None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:58.749902 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae7718-ed9a-40be-a5f9-ed28f10d5fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:58.750556 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae7718-ed9a-40be-a5f9-ed28f10d5fa3 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:58.750980 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae7718-ed9a-40be-a5f9-ed28f10d5fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:58.751261 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae7718-ed9a-40be-a5f9-ed28f10d5fa3 None admin] PATH_INFO: `/v3/groups/e386b3b088094609bd1c524d30752a9f` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:58.752583 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae7718-ed9a-40be-a5f9-ed28f10d5fa3 None admin] RBAC: Authorizing `identity:get_group(group_id=e386b3b088094609bd1c524d30752a9f)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:58.754142 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae7718-ed9a-40be-a5f9-ed28f10d5fa3 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:58.756474 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 196/397] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 20:28:58 2022] GET /identity/v3/groups/e386b3b088094609bd1c524d30752a9f => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:58.757689 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52472598-bcc0-4603-b952-033fbcf0c8bc None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:58.757974 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52472598-bcc0-4603-b952-033fbcf0c8bc None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:58.758250 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52472598-bcc0-4603-b952-033fbcf0c8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:58.774673 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fe67b-8119-41e7-8cf7-125d33cc7823 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:58.777869 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:58.779702 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-52472598-bcc0-4603-b952-033fbcf0c8bc None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:58.781195 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-52472598-bcc0-4603-b952-033fbcf0c8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:58.815021 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5ee9c-706b-497b-b8d6-c0a8abb168fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:58.815740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5ee9c-706b-497b-b8d6-c0a8abb168fe None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:58.816154 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5ee9c-706b-497b-b8d6-c0a8abb168fe None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:58.816440 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5ee9c-706b-497b-b8d6-c0a8abb168fe None admin] PATH_INFO: `/v3/groups/e386b3b088094609bd1c524d30752a9f` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:58.818202 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5ee9c-706b-497b-b8d6-c0a8abb168fe None admin] RBAC: Authorizing `identity:get_group(group_id=e386b3b088094609bd1c524d30752a9f)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:58.820165 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5ee9c-706b-497b-b8d6-c0a8abb168fe None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:58.822128 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 202/398] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 20:28:58 2022] GET /identity/v3/groups/e386b3b088094609bd1c524d30752a9f => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:58.824409 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5ee9c-706b-497b-b8d6-c0a8abb168fe None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:58.876015 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 197/399] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:58.877297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52472598-bcc0-4603-b952-033fbcf0c8bc None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:58.955120 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:58.986977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5ee9c-706b-497b-b8d6-c0a8abb168fe None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:59.021016 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52472598-bcc0-4603-b952-033fbcf0c8bc None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:59.051823 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be6b73-61ac-4948-9cab-4a9006cab4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:59.052907 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be6b73-61ac-4948-9cab-4a9006cab4e2 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:59.053397 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be6b73-61ac-4948-9cab-4a9006cab4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:59.053881 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be6b73-61ac-4948-9cab-4a9006cab4e2 None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:59.056038 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be6b73-61ac-4948-9cab-4a9006cab4e2 None admin] RBAC: Authorizing `identity:get_project(project_id=45f63f10100747b9b9eaf0e3e8021980)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:59.058817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be6b73-61ac-4948-9cab-4a9006cab4e2 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:59.062636 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 203/400] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:58 2022] GET /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:59.066794 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50f6fd-2e29-4465-9131-11a44aecb6a6 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:59.066794 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50f6fd-2e29-4465-9131-11a44aecb6a6 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:59.066794 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50f6fd-2e29-4465-9131-11a44aecb6a6 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:59.068413 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 204/401] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:28:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:59.069848 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50f6fd-2e29-4465-9131-11a44aecb6a6 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:59.087155 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b60118-8de4-41f7-94f2-2b3ff33040fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:59.088006 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b60118-8de4-41f7-94f2-2b3ff33040fe None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:59.088292 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b60118-8de4-41f7-94f2-2b3ff33040fe None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:59.088566 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b60118-8de4-41f7-94f2-2b3ff33040fe None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:59.089769 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b60118-8de4-41f7-94f2-2b3ff33040fe None admin] RBAC: Authorizing `identity:get_project(project_id=7bb022d88d4f49bc889242cf22018981)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:59.091450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b60118-8de4-41f7-94f2-2b3ff33040fe None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:59.094132 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 198/402] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:58 2022] GET /identity/v3/projects/7bb022d88d4f49bc889242cf22018981 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:59.095368 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8c621-8dd6-4636-a975-249e902e0295 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:59.096380 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8c621-8dd6-4636-a975-249e902e0295 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:59.096380 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8c621-8dd6-4636-a975-249e902e0295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:59.123493 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-c7d8c621-8dd6-4636-a975-249e902e0295 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:59.125685 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-c7d8c621-8dd6-4636-a975-249e902e0295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:59.159179 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:59.246112 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 199/403] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:28:59.248288 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8c621-8dd6-4636-a975-249e902e0295 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:59.276176 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50f6fd-2e29-4465-9131-11a44aecb6a6 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:59.334104 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5414f-bd4d-496b-a398-7fcfd3acf872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:59.334919 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5414f-bd4d-496b-a398-7fcfd3acf872 None admin] REQUEST_METHOD: `PUT` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:59.335367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5414f-bd4d-496b-a398-7fcfd3acf872 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:59.335811 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5414f-bd4d-496b-a398-7fcfd3acf872 None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980/groups/e386b3b088094609bd1c524d30752a9f/roles/910e8004690649e3b4fc1c4be76ad967` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:59.339505 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5414f-bd4d-496b-a398-7fcfd3acf872 None admin] RBAC: Authorizing `identity:create_grant(project_id=45f63f10100747b9b9eaf0e3e8021980, group_id=e386b3b088094609bd1c524d30752a9f, role_id=910e8004690649e3b4fc1c4be76ad967)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:59.342239 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5414f-bd4d-496b-a398-7fcfd3acf872 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:59.361553 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:59.422219 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8c621-8dd6-4636-a975-249e902e0295 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:59.480988 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 205/404] 10.222.0.15 () {58 vars in 1442 bytes} [Mon Aug 22 20:28:59 2022] PUT /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980/groups/e386b3b088094609bd1c524d30752a9f/roles/910e8004690649e3b4fc1c4be76ad967 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:28:59.480988 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5414f-bd4d-496b-a398-7fcfd3acf872 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:59.488922 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfabb6-f96c-46fa-ab4d-4ab254a7e9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:59.490543 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfabb6-f96c-46fa-ab4d-4ab254a7e9ad None admin] REQUEST_METHOD: `PUT` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:59.491342 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfabb6-f96c-46fa-ab4d-4ab254a7e9ad None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:59.492119 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfabb6-f96c-46fa-ab4d-4ab254a7e9ad None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981/groups/e386b3b088094609bd1c524d30752a9f/roles/fcd9a48e6c4b4c048380a57be435c3dd` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:59.501935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfabb6-f96c-46fa-ab4d-4ab254a7e9ad None admin] RBAC: Authorizing `identity:create_grant(project_id=7bb022d88d4f49bc889242cf22018981, group_id=e386b3b088094609bd1c524d30752a9f, role_id=fcd9a48e6c4b4c048380a57be435c3dd)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:59.505314 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfabb6-f96c-46fa-ab4d-4ab254a7e9ad None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:59.599695 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 200/405] 10.222.0.15 () {58 vars in 1442 bytes} [Mon Aug 22 20:28:59 2022] PUT /identity/v3/projects/7bb022d88d4f49bc889242cf22018981/groups/e386b3b088094609bd1c524d30752a9f/roles/fcd9a48e6c4b4c048380a57be435c3dd => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:28:59.619441 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:59.630733 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5414f-bd4d-496b-a398-7fcfd3acf872 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:59.694555 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4423a-3586-4696-962d-78a6ed6401b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:59.695238 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4423a-3586-4696-962d-78a6ed6401b8 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:59.695521 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4423a-3586-4696-962d-78a6ed6401b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:59.695830 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4423a-3586-4696-962d-78a6ed6401b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:59.718058 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4423a-3586-4696-962d-78a6ed6401b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:59.723200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-38e4423a-3586-4696-962d-78a6ed6401b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:59.723200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:59.723200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:59.723200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:59.723200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:59.723200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:59.723200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:59.723200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:59.723200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:59.723200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:59.723200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:59.723200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:59.723200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:59.723200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:59.723200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:59.723200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:59.724371 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:59.724371 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:59.724371 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:59.724371 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:59.724371 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:59.724371 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:59.724371 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:59.724371 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:59.724371 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:59.724371 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:59.724371 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:59.724371 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:59.724371 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:59.724371 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:59.724371 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:59.724371 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:59.725293 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:59.725293 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:59.725293 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:59.725293 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:59.725293 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:59.725293 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:59.725293 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:59.725293 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:59.725293 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:59.725293 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:59.725293 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:59.725293 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:28:59.725293 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 206/406] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 20:28:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:59.730773 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfabb6-f96c-46fa-ab4d-4ab254a7e9ad None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:59.826431 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4423a-3586-4696-962d-78a6ed6401b8 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:59.897811 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfabb6-f96c-46fa-ab4d-4ab254a7e9ad None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:59.915986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:59.941197 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7101e3-9fc4-43a6-bdf5-70b93e5845f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:59.942156 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7101e3-9fc4-43a6-bdf5-70b93e5845f7 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:59.942578 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7101e3-9fc4-43a6-bdf5-70b93e5845f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:59.943266 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7101e3-9fc4-43a6-bdf5-70b93e5845f7 None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:59.944580 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7101e3-9fc4-43a6-bdf5-70b93e5845f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:59.945014 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7101e3-9fc4-43a6-bdf5-70b93e5845f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:59.947877 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7101e3-9fc4-43a6-bdf5-70b93e5845f7 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:59.964971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 201/407] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:59.972347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7101e3-9fc4-43a6-bdf5-70b93e5845f7 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:59.975791 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4423a-3586-4696-962d-78a6ed6401b8 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:00.078804 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed575fc-57f3-40e0-85e3-d949df700838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:00.082292 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed575fc-57f3-40e0-85e3-d949df700838 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:00.082840 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed575fc-57f3-40e0-85e3-d949df700838 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:00.083342 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed575fc-57f3-40e0-85e3-d949df700838 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:00.107654 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed575fc-57f3-40e0-85e3-d949df700838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:00.113893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-5ed575fc-57f3-40e0-85e3-d949df700838 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:29:00.113893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:00.113893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:00.113893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:00.113893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:00.113893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:00.113893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:00.113893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:00.113893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:00.113893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:00.113893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:00.113893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:00.113893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:00.113893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:00.113893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:00.113893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:00.114832 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:00.114832 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:00.114832 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:00.114832 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:00.114832 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:00.114832 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:00.114832 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:00.114832 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:00.114832 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:00.114832 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:00.114832 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:00.114832 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:00.114832 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:00.114832 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:00.114832 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:00.114832 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:00.115656 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:00.115656 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:00.115656 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:00.115656 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:00.115656 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:00.115656 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:00.115656 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:00.115656 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:00.115656 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:00.115656 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:00.115656 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:29:00.115656 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:00.118430 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 207/408] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 20:28:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:00.125364 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed575fc-57f3-40e0-85e3-d949df700838 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:00.156690 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:00.220272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7101e3-9fc4-43a6-bdf5-70b93e5845f7 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:00.298561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468324f-39dc-4f47-8df8-24605972bab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:00.299224 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468324f-39dc-4f47-8df8-24605972bab8 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:00.299505 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468324f-39dc-4f47-8df8-24605972bab8 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:00.299858 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468324f-39dc-4f47-8df8-24605972bab8 None admin] PATH_INFO: `/v3/groups/73f34a58e16c4627aba449239ba3847c` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:00.301948 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed575fc-57f3-40e0-85e3-d949df700838 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:00.302617 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468324f-39dc-4f47-8df8-24605972bab8 None admin] RBAC: Authorizing `identity:get_group(group_id=73f34a58e16c4627aba449239ba3847c)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:00.304265 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468324f-39dc-4f47-8df8-24605972bab8 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:00.306081 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 202/409] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 20:28:59 2022] GET /identity/v3/groups/73f34a58e16c4627aba449239ba3847c => generated 229 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:00.317850 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468324f-39dc-4f47-8df8-24605972bab8 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:00.362612 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3ac85-dfa5-4dd7-9ecf-e56886b7d7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:00.364593 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3ac85-dfa5-4dd7-9ecf-e56886b7d7d6 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:00.364888 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3ac85-dfa5-4dd7-9ecf-e56886b7d7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:00.365219 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3ac85-dfa5-4dd7-9ecf-e56886b7d7d6 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:00.366114 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3ac85-dfa5-4dd7-9ecf-e56886b7d7d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:00.366423 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3ac85-dfa5-4dd7-9ecf-e56886b7d7d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:00.367906 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3ac85-dfa5-4dd7-9ecf-e56886b7d7d6 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:00.379377 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 208/410] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:00.387316 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3ac85-dfa5-4dd7-9ecf-e56886b7d7d6 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:00.428034 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:00.503937 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468324f-39dc-4f47-8df8-24605972bab8 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:00.568648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:00.578866 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148680ad-ed4b-4689-9c14-24aa1fba2deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:00.588933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148680ad-ed4b-4689-9c14-24aa1fba2deb None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:00.588933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148680ad-ed4b-4689-9c14-24aa1fba2deb None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:00.588933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148680ad-ed4b-4689-9c14-24aa1fba2deb None admin] PATH_INFO: `/v3/projects/41d17f0c019c419fa2ba2277c76a76b5` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:00.590660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148680ad-ed4b-4689-9c14-24aa1fba2deb None admin] RBAC: Authorizing `identity:get_project(project_id=41d17f0c019c419fa2ba2277c76a76b5)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:00.593620 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148680ad-ed4b-4689-9c14-24aa1fba2deb None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:00.602050 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3ac85-dfa5-4dd7-9ecf-e56886b7d7d6 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:00.604069 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 203/411] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:29:00 2022] GET /identity/v3/projects/41d17f0c019c419fa2ba2277c76a76b5 => generated 344 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:00.635121 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148680ad-ed4b-4689-9c14-24aa1fba2deb None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:00.675868 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4ae04-ca76-44fa-92c7-7362dcb4f113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:00.676964 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4ae04-ca76-44fa-92c7-7362dcb4f113 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:00.677460 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4ae04-ca76-44fa-92c7-7362dcb4f113 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:00.677947 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4ae04-ca76-44fa-92c7-7362dcb4f113 None admin] PATH_INFO: `/v3/groups/e386b3b088094609bd1c524d30752a9f` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:00.680050 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4ae04-ca76-44fa-92c7-7362dcb4f113 None admin] RBAC: Authorizing `identity:get_group(group_id=e386b3b088094609bd1c524d30752a9f)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:00.682611 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4ae04-ca76-44fa-92c7-7362dcb4f113 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:00.685916 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 209/412] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 20:29:00 2022] GET /identity/v3/groups/e386b3b088094609bd1c524d30752a9f => generated 226 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:00.692837 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4ae04-ca76-44fa-92c7-7362dcb4f113 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:00.834029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148680ad-ed4b-4689-9c14-24aa1fba2deb None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:00.852305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:00.873051 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a6cdd-23fd-44df-8b05-a2505c7a54e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:00.873802 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a6cdd-23fd-44df-8b05-a2505c7a54e1 None admin] REQUEST_METHOD: `PUT` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:00.874630 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a6cdd-23fd-44df-8b05-a2505c7a54e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:00.874902 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a6cdd-23fd-44df-8b05-a2505c7a54e1 None admin] PATH_INFO: `/v3/projects/41d17f0c019c419fa2ba2277c76a76b5/groups/73f34a58e16c4627aba449239ba3847c/roles/1e3ce9c8b9934a7bb515b39e21fc1d68` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:00.877210 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a6cdd-23fd-44df-8b05-a2505c7a54e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=41d17f0c019c419fa2ba2277c76a76b5, group_id=73f34a58e16c4627aba449239ba3847c, role_id=1e3ce9c8b9934a7bb515b39e21fc1d68)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:00.878709 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a6cdd-23fd-44df-8b05-a2505c7a54e1 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:00.908057 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4ae04-ca76-44fa-92c7-7362dcb4f113 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:00.949977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f88ac-bdf5-4d60-928e-97d3b5f5240b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:00.950526 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f88ac-bdf5-4d60-928e-97d3b5f5240b None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:00.950806 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f88ac-bdf5-4d60-928e-97d3b5f5240b None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:00.951077 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f88ac-bdf5-4d60-928e-97d3b5f5240b None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:00.952418 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f88ac-bdf5-4d60-928e-97d3b5f5240b None admin] RBAC: Authorizing `identity:get_project(project_id=45f63f10100747b9b9eaf0e3e8021980)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:00.954065 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f88ac-bdf5-4d60-928e-97d3b5f5240b None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:00.956169 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 210/413] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:29:00 2022] GET /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:00.965175 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f88ac-bdf5-4d60-928e-97d3b5f5240b None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:00.972000 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 204/414] 10.222.0.15 () {58 vars in 1442 bytes} [Mon Aug 22 20:29:00 2022] PUT /identity/v3/projects/41d17f0c019c419fa2ba2277c76a76b5/groups/73f34a58e16c4627aba449239ba3847c/roles/1e3ce9c8b9934a7bb515b39e21fc1d68 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:29:00.994257 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:01.018271 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3434a5-991e-4378-8148-c169eac3c1d2 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:01.018673 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3434a5-991e-4378-8148-c169eac3c1d2 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:01.018910 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3434a5-991e-4378-8148-c169eac3c1d2 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:01.021835 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 205/415] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:29:01.030255 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be623fc3-3fdd-4abb-b9ca-163130b41f3e None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:01.031091 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be623fc3-3fdd-4abb-b9ca-163130b41f3e None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:01.033331 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be623fc3-3fdd-4abb-b9ca-163130b41f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:01.064364 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-be623fc3-3fdd-4abb-b9ca-163130b41f3e None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:01.066878 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-be623fc3-3fdd-4abb-b9ca-163130b41f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:01.180376 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f88ac-bdf5-4d60-928e-97d3b5f5240b None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:01.234072 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 206/416] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:29:01.247330 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbf6ed-1620-42c9-878b-a2dff4329a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:01.248063 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbf6ed-1620-42c9-878b-a2dff4329a08 None admin] REQUEST_METHOD: `PUT` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:01.248338 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbf6ed-1620-42c9-878b-a2dff4329a08 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:01.248615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbf6ed-1620-42c9-878b-a2dff4329a08 None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980/groups/e386b3b088094609bd1c524d30752a9f/roles/fcd9a48e6c4b4c048380a57be435c3dd` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:01.251090 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbbf6ed-1620-42c9-878b-a2dff4329a08 None admin] RBAC: Authorizing `identity:create_grant(project_id=45f63f10100747b9b9eaf0e3e8021980, group_id=e386b3b088094609bd1c524d30752a9f, role_id=fcd9a48e6c4b4c048380a57be435c3dd)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:01.252615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbbf6ed-1620-42c9-878b-a2dff4329a08 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:01.354733 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 211/417] 10.222.0.15 () {58 vars in 1442 bytes} [Mon Aug 22 20:29:00 2022] PUT /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980/groups/e386b3b088094609bd1c524d30752a9f/roles/fcd9a48e6c4b4c048380a57be435c3dd => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:29:01.739068 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be623fc3-3fdd-4abb-b9ca-163130b41f3e None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:01.958004 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be623fc3-3fdd-4abb-b9ca-163130b41f3e None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:01.960764 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:02.020367 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bace5f-d9a5-469b-9a73-8e50e62eaea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:02.021415 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bace5f-d9a5-469b-9a73-8e50e62eaea0 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:02.021875 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bace5f-d9a5-469b-9a73-8e50e62eaea0 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:02.022328 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bace5f-d9a5-469b-9a73-8e50e62eaea0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:02.041343 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bace5f-d9a5-469b-9a73-8e50e62eaea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:02.051908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-56bace5f-d9a5-469b-9a73-8e50e62eaea0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:29:02.051908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:02.051908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:02.051908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:02.051908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:02.051908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:02.051908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:02.051908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:02.051908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:02.051908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:02.051908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:02.051908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:02.051908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:02.051908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:02.051908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:02.051908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:02.052839 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:02.052839 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:02.052839 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:02.052839 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:02.052839 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:02.052839 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:02.052839 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:02.052839 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:02.052839 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:02.052839 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:02.052839 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:02.052839 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:02.052839 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:02.052839 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:02.052839 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:02.052839 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:02.053637 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:02.053637 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:02.053637 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:02.053637 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:02.053637 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:02.053637 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:02.053637 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:02.053637 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:02.053637 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:02.053637 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:02.053637 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:29:02.053637 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:02.054314 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 207/418] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:29:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:02.063981 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbf6ed-1620-42c9-878b-a2dff4329a08 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:02.286488 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:02.336729 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbf6ed-1620-42c9-878b-a2dff4329a08 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:02.392958 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7c1c2-c317-4d42-a991-7290fdc8de32 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:02.393450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7c1c2-c317-4d42-a991-7290fdc8de32 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:02.393935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7c1c2-c317-4d42-a991-7290fdc8de32 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:02.404057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 208/419] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:02 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:02.407603 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615826bb-bf6e-4144-a9ea-a7064dabee43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:02.408483 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615826bb-bf6e-4144-a9ea-a7064dabee43 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:02.408962 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615826bb-bf6e-4144-a9ea-a7064dabee43 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:02.409428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615826bb-bf6e-4144-a9ea-a7064dabee43 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:02.410318 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615826bb-bf6e-4144-a9ea-a7064dabee43 None admin] RBAC: Adding query filter params (name=member) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:02.410880 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615826bb-bf6e-4144-a9ea-a7064dabee43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:02.412518 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615826bb-bf6e-4144-a9ea-a7064dabee43 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:02.413089 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cc091-986f-4c96-8e4a-ccc45278f8a1 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:02.413566 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cc091-986f-4c96-8e4a-ccc45278f8a1 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:02.414109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cc091-986f-4c96-8e4a-ccc45278f8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:02.424466 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 212/420] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:29:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:02.433462 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615826bb-bf6e-4144-a9ea-a7064dabee43 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:02.448898 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-240cc091-986f-4c96-8e4a-ccc45278f8a1 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:02.450497 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-240cc091-986f-4c96-8e4a-ccc45278f8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:02.525458 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 209/421] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:29:02.616787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615826bb-bf6e-4144-a9ea-a7064dabee43 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:02.660018 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fbcd8-51eb-4e64-9110-52154dbecd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:02.660652 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fbcd8-51eb-4e64-9110-52154dbecd52 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:02.660934 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fbcd8-51eb-4e64-9110-52154dbecd52 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:02.661208 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fbcd8-51eb-4e64-9110-52154dbecd52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:02.673694 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:02.771601 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fbcd8-51eb-4e64-9110-52154dbecd52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:02.773138 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fbcd8-51eb-4e64-9110-52154dbecd52 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:02.913143 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 213/422] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:29:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 20:29:02.922545 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cc091-986f-4c96-8e4a-ccc45278f8a1 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:03.055931 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:03.067495 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cc091-986f-4c96-8e4a-ccc45278f8a1 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:03.106372 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590f868-0ec1-4308-b9d2-5398cf6db18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:03.107018 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590f868-0ec1-4308-b9d2-5398cf6db18c None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:03.107298 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590f868-0ec1-4308-b9d2-5398cf6db18c None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:03.107578 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590f868-0ec1-4308-b9d2-5398cf6db18c None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:03.108906 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590f868-0ec1-4308-b9d2-5398cf6db18c None admin] RBAC: Authorizing `identity:get_project(project_id=7bb022d88d4f49bc889242cf22018981)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:03.110413 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590f868-0ec1-4308-b9d2-5398cf6db18c None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:03.112972 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 210/423] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:29:02 2022] GET /identity/v3/projects/7bb022d88d4f49bc889242cf22018981 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:03.121089 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fbcd8-51eb-4e64-9110-52154dbecd52 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:03.180380 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:03.250660 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fbcd8-51eb-4e64-9110-52154dbecd52 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:03.288248 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4712d2-af77-406a-a1fe-b34ae5b47504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:03.289213 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4712d2-af77-406a-a1fe-b34ae5b47504 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:03.289213 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4712d2-af77-406a-a1fe-b34ae5b47504 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:03.289492 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4712d2-af77-406a-a1fe-b34ae5b47504 None admin] PATH_INFO: `/v3/groups/e386b3b088094609bd1c524d30752a9f` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:03.290660 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4712d2-af77-406a-a1fe-b34ae5b47504 None admin] RBAC: Authorizing `identity:get_group(group_id=e386b3b088094609bd1c524d30752a9f)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:03.292316 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4712d2-af77-406a-a1fe-b34ae5b47504 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:03.294255 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 214/424] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 20:29:03 2022] GET /identity/v3/groups/e386b3b088094609bd1c524d30752a9f => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:03.300073 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590f868-0ec1-4308-b9d2-5398cf6db18c None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:03.314589 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4712d2-af77-406a-a1fe-b34ae5b47504 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:03.429793 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4712d2-af77-406a-a1fe-b34ae5b47504 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:03.454662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:03.470164 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12230e-0730-4acc-91e3-3299cee03326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:03.470876 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12230e-0730-4acc-91e3-3299cee03326 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:03.472117 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12230e-0730-4acc-91e3-3299cee03326 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:03.472117 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12230e-0730-4acc-91e3-3299cee03326 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:03.483432 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12230e-0730-4acc-91e3-3299cee03326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:03.488770 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-2b12230e-0730-4acc-91e3-3299cee03326 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:29:03.488770 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:03.488770 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:03.488770 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:03.488770 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:03.488770 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:03.488770 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:03.488770 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:03.488770 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:03.488770 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:03.488770 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:03.488770 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:03.488770 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:03.488770 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:03.488770 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:03.488770 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:03.490682 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:03.490682 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:03.490682 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:03.490682 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:03.490682 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:03.490682 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:03.490682 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:03.490682 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:03.490682 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:03.490682 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:03.490682 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:03.490682 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:03.490682 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:03.490682 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:03.490682 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:03.490682 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:03.492277 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:03.492277 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:03.492277 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:03.492277 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:03.492277 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:03.492277 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:03.492277 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:03.492277 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:03.492277 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:03.492277 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:03.492277 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:29:03.492277 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:03.492277 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 215/425] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 20:29:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:03.501597 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08447f-d411-412e-a07d-86c7d5591fb9 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:03.501991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08447f-d411-412e-a07d-86c7d5591fb9 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:03.502412 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08447f-d411-412e-a07d-86c7d5591fb9 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:03.505093 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 216/426] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:29:03.506522 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08447f-d411-412e-a07d-86c7d5591fb9 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:03.628746 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590f868-0ec1-4308-b9d2-5398cf6db18c None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:03.653941 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08447f-d411-412e-a07d-86c7d5591fb9 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:03.698503 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b154f6-2f9b-4e3c-b882-cfba14efc33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:03.699128 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b154f6-2f9b-4e3c-b882-cfba14efc33b None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:03.699412 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b154f6-2f9b-4e3c-b882-cfba14efc33b None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:03.699723 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b154f6-2f9b-4e3c-b882-cfba14efc33b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:03.700790 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b154f6-2f9b-4e3c-b882-cfba14efc33b None admin] RBAC: Adding query filter params (group.id=e386b3b088094609bd1c524d30752a9f, role.id=910e8004690649e3b4fc1c4be76ad967, scope.project.id=7bb022d88d4f49bc889242cf22018981) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:03.701105 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b154f6-2f9b-4e3c-b882-cfba14efc33b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:03.703885 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b154f6-2f9b-4e3c-b882-cfba14efc33b None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:03.712246 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16044d4-51ba-45f2-8051-120836473b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:03.713820 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16044d4-51ba-45f2-8051-120836473b38 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:03.714527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16044d4-51ba-45f2-8051-120836473b38 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:03.715349 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16044d4-51ba-45f2-8051-120836473b38 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:03.717084 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16044d4-51ba-45f2-8051-120836473b38 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:03.718492 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16044d4-51ba-45f2-8051-120836473b38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:03.718650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 211/427] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Aug 22 20:29:03 2022] GET /identity/v3/role_assignments?group.id=e386b3b088094609bd1c524d30752a9f&scope.project.id=7bb022d88d4f49bc889242cf22018981&role.id=910e8004690649e3b4fc1c4be76ad967 => generated 611 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:03.720164 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee683ad-2827-4c50-b52e-261a38e4479a None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:03.720435 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee683ad-2827-4c50-b52e-261a38e4479a None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:03.720711 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee683ad-2827-4c50-b52e-261a38e4479a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:03.722537 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16044d4-51ba-45f2-8051-120836473b38 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:03.740896 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 217/428] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:03.751910 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16044d4-51ba-45f2-8051-120836473b38 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:03.756658 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-3ee683ad-2827-4c50-b52e-261a38e4479a None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:03.758222 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-3ee683ad-2827-4c50-b52e-261a38e4479a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:03.780211 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:03.854701 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:03.941792 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 212/429] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:29:04.026639 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16044d4-51ba-45f2-8051-120836473b38 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:04.085310 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6bacc-84db-48c9-8f06-631917ace9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:04.085941 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6bacc-84db-48c9-8f06-631917ace9c1 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:04.086224 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6bacc-84db-48c9-8f06-631917ace9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:04.086473 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6bacc-84db-48c9-8f06-631917ace9c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:04.188137 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6bacc-84db-48c9-8f06-631917ace9c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:04.189692 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6bacc-84db-48c9-8f06-631917ace9c1 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:04.228097 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:04.316774 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 218/430] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:29:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 20:29:04.323571 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee683ad-2827-4c50-b52e-261a38e4479a None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:04.460501 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6bacc-84db-48c9-8f06-631917ace9c1 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:04.472210 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee683ad-2827-4c50-b52e-261a38e4479a None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:04.521909 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900111af-0a57-497a-9f41-c56649a4aace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:04.525954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900111af-0a57-497a-9f41-c56649a4aace None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:04.525954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900111af-0a57-497a-9f41-c56649a4aace None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:04.525954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900111af-0a57-497a-9f41-c56649a4aace None admin] PATH_INFO: `/v3/projects/7bb022d88d4f49bc889242cf22018981` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:04.525954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900111af-0a57-497a-9f41-c56649a4aace None admin] RBAC: Authorizing `identity:get_project(project_id=7bb022d88d4f49bc889242cf22018981)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:04.531717 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900111af-0a57-497a-9f41-c56649a4aace None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:04.535600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 213/431] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:29:04 2022] GET /identity/v3/projects/7bb022d88d4f49bc889242cf22018981 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:04.541503 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900111af-0a57-497a-9f41-c56649a4aace None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:04.575863 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:04.627182 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6bacc-84db-48c9-8f06-631917ace9c1 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:04.674790 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:04.683134 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8e1be-6bb1-48d8-aea8-42ec3c836e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:04.683852 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8e1be-6bb1-48d8-aea8-42ec3c836e8a None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:04.684140 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8e1be-6bb1-48d8-aea8-42ec3c836e8a None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:04.684416 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8e1be-6bb1-48d8-aea8-42ec3c836e8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:04.694771 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900111af-0a57-497a-9f41-c56649a4aace None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:04.705487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8e1be-6bb1-48d8-aea8-42ec3c836e8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:04.705487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-b7a8e1be-6bb1-48d8-aea8-42ec3c836e8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:29:04.705487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:04.705487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:04.705487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:04.705487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:04.705487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:04.705487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:04.705487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:04.705487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:04.705487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:04.705487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:04.705487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:04.705487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:04.706474 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:04.706474 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:04.706474 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:04.706474 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:04.706474 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:04.706474 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:04.706474 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:04.706474 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:04.706474 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:04.706474 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:04.706474 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:04.706474 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:04.706474 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:04.706474 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:04.706474 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:04.706474 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:04.706474 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:04.707349 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:04.707349 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:04.707349 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:04.707349 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:04.707349 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:04.707349 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:04.707349 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:04.707349 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:04.707349 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:04.707349 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:04.707349 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:04.707349 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:04.707349 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:29:04.707349 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:04.708679 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 219/432] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:29:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:04.712026 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c5169-7dea-49f5-9237-5dd63f25d4b9 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:04.712026 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c5169-7dea-49f5-9237-5dd63f25d4b9 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:04.712026 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c5169-7dea-49f5-9237-5dd63f25d4b9 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:04.714118 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 220/433] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:04.716012 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c5169-7dea-49f5-9237-5dd63f25d4b9 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:04.751575 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b35ca2-174f-4ed2-9a1b-42cf481c402c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:04.752270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b35ca2-174f-4ed2-9a1b-42cf481c402c None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:04.752526 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b35ca2-174f-4ed2-9a1b-42cf481c402c None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:04.752774 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b35ca2-174f-4ed2-9a1b-42cf481c402c None admin] PATH_INFO: `/v3/groups/e386b3b088094609bd1c524d30752a9f` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:04.753950 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b35ca2-174f-4ed2-9a1b-42cf481c402c None admin] RBAC: Authorizing `identity:get_group(group_id=e386b3b088094609bd1c524d30752a9f)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:04.755410 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b35ca2-174f-4ed2-9a1b-42cf481c402c None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:04.757092 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 214/434] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 20:29:04 2022] GET /identity/v3/groups/e386b3b088094609bd1c524d30752a9f => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:04.763404 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da820e-140f-4e0b-8c81-ea0245f7528a None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:04.763404 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da820e-140f-4e0b-8c81-ea0245f7528a None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:04.763404 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da820e-140f-4e0b-8c81-ea0245f7528a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:04.793049 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-09da820e-140f-4e0b-8c81-ea0245f7528a None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:04.795650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-09da820e-140f-4e0b-8c81-ea0245f7528a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:04.895971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 215/435] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:29:04.896810 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da820e-140f-4e0b-8c81-ea0245f7528a None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:04.912716 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c5169-7dea-49f5-9237-5dd63f25d4b9 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:04.938243 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:04.980891 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106b29e-dbea-41b7-ac8b-2e0b234218b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:04.982612 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106b29e-dbea-41b7-ac8b-2e0b234218b9 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:04.983191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106b29e-dbea-41b7-ac8b-2e0b234218b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:04.983746 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106b29e-dbea-41b7-ac8b-2e0b234218b9 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:04.985098 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106b29e-dbea-41b7-ac8b-2e0b234218b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:04.985569 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106b29e-dbea-41b7-ac8b-2e0b234218b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:04.988593 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106b29e-dbea-41b7-ac8b-2e0b234218b9 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:05.012260 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 221/436] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:29:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:05.017479 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106b29e-dbea-41b7-ac8b-2e0b234218b9 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:05.054376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da820e-140f-4e0b-8c81-ea0245f7528a None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:05.101303 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ca507-1d1e-44e9-927b-0b9d7cfc1097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:05.102334 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ca507-1d1e-44e9-927b-0b9d7cfc1097 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:05.102827 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ca507-1d1e-44e9-927b-0b9d7cfc1097 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:05.103299 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ca507-1d1e-44e9-927b-0b9d7cfc1097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:05.104682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ca507-1d1e-44e9-927b-0b9d7cfc1097 None admin] RBAC: Adding query filter params (group.id=e386b3b088094609bd1c524d30752a9f, role.id=fcd9a48e6c4b4c048380a57be435c3dd, scope.project.id=7bb022d88d4f49bc889242cf22018981) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:05.105223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ca507-1d1e-44e9-927b-0b9d7cfc1097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:05.107867 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:05.108007 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ca507-1d1e-44e9-927b-0b9d7cfc1097 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:05.118986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 216/437] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Aug 22 20:29:04 2022] GET /identity/v3/role_assignments?group.id=e386b3b088094609bd1c524d30752a9f&scope.project.id=7bb022d88d4f49bc889242cf22018981&role.id=fcd9a48e6c4b4c048380a57be435c3dd => generated 611 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:05.120883 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79678b07-0c73-4be5-9642-010c9c81b931 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:05.129012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79678b07-0c73-4be5-9642-010c9c81b931 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:05.129012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79678b07-0c73-4be5-9642-010c9c81b931 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:05.129012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 217/438] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:05.131630 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5b129-7cb5-4b53-800a-d510982dccd6 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:05.132123 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5b129-7cb5-4b53-800a-d510982dccd6 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:05.132460 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5b129-7cb5-4b53-800a-d510982dccd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:05.168095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-22c5b129-7cb5-4b53-800a-d510982dccd6 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:05.170323 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-22c5b129-7cb5-4b53-800a-d510982dccd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:05.175916 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106b29e-dbea-41b7-ac8b-2e0b234218b9 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:05.237245 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975cce5-1aa5-4e65-8dc9-a251bc6036ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:05.238755 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975cce5-1aa5-4e65-8dc9-a251bc6036ac None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:05.239248 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975cce5-1aa5-4e65-8dc9-a251bc6036ac None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:05.240799 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975cce5-1aa5-4e65-8dc9-a251bc6036ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:05.299594 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 218/439] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:29:05.299594 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5b129-7cb5-4b53-800a-d510982dccd6 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:05.319319 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:05.353298 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975cce5-1aa5-4e65-8dc9-a251bc6036ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:05.354805 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975cce5-1aa5-4e65-8dc9-a251bc6036ac None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:05.441523 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:05.468328 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5b129-7cb5-4b53-800a-d510982dccd6 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:05.525803 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 222/440] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:29:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 20:29:05.528503 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcb302-79a8-4891-9d67-c41de8cd53b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:05.529176 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcb302-79a8-4891-9d67-c41de8cd53b4 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:05.529467 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcb302-79a8-4891-9d67-c41de8cd53b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:05.529786 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcb302-79a8-4891-9d67-c41de8cd53b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:05.531952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975cce5-1aa5-4e65-8dc9-a251bc6036ac None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:05.560011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcb302-79a8-4891-9d67-c41de8cd53b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:05.571086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-e3fcb302-79a8-4891-9d67-c41de8cd53b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:29:05.571086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:05.571086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:05.571086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:05.571086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:05.571086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:05.571086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:05.571086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:05.571086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:05.571086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:05.571086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:05.571086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:05.571086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:05.571086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:05.571086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:05.571086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:05.572257 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:05.572257 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:05.572257 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:05.572257 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:05.572257 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:05.572257 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:05.572257 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:05.572257 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:05.572257 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:05.572257 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:05.572257 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:05.572257 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:05.572257 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:05.572257 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:05.572257 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:05.572257 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:05.573191 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:05.573191 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:05.573191 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:05.573191 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:05.573191 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:05.573191 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:05.573191 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:05.573191 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:05.573191 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:05.573191 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:05.573191 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:29:05.573191 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:05.573191 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 219/441] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 20:29:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:05.581595 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcb302-79a8-4891-9d67-c41de8cd53b4 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:05.681408 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:05.718875 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975cce5-1aa5-4e65-8dc9-a251bc6036ac None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:05.719136 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcb302-79a8-4891-9d67-c41de8cd53b4 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:05.758578 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38782d7-61e9-4193-8d90-a5434efaa04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:05.759264 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38782d7-61e9-4193-8d90-a5434efaa04e None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:05.759429 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a2eb0-869b-46a0-bbea-3c3d70e5310a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:05.759610 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38782d7-61e9-4193-8d90-a5434efaa04e None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:05.759826 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38782d7-61e9-4193-8d90-a5434efaa04e None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:05.759951 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a2eb0-869b-46a0-bbea-3c3d70e5310a None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:05.760198 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a2eb0-869b-46a0-bbea-3c3d70e5310a None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:05.760473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a2eb0-869b-46a0-bbea-3c3d70e5310a None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:05.761046 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38782d7-61e9-4193-8d90-a5434efaa04e None admin] RBAC: Authorizing `identity:get_project(project_id=45f63f10100747b9b9eaf0e3e8021980)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:05.761207 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a2eb0-869b-46a0-bbea-3c3d70e5310a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:05.761556 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a2eb0-869b-46a0-bbea-3c3d70e5310a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:05.762619 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38782d7-61e9-4193-8d90-a5434efaa04e None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:05.762919 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a2eb0-869b-46a0-bbea-3c3d70e5310a None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:05.769302 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 223/442] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:29:05 2022] GET /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:05.769302 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38782d7-61e9-4193-8d90-a5434efaa04e None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:05.777510 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 220/443] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:29:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:05.781306 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a2eb0-869b-46a0-bbea-3c3d70e5310a None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:05.789195 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:05.876687 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38782d7-61e9-4193-8d90-a5434efaa04e None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:05.899905 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a2eb0-869b-46a0-bbea-3c3d70e5310a None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:05.916852 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3376791-f3d5-4316-bd55-c0b3d720f529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:05.917481 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3376791-f3d5-4316-bd55-c0b3d720f529 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:05.917758 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3376791-f3d5-4316-bd55-c0b3d720f529 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:05.918086 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3376791-f3d5-4316-bd55-c0b3d720f529 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:05.929567 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3376791-f3d5-4316-bd55-c0b3d720f529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:05.934333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-f3376791-f3d5-4316-bd55-c0b3d720f529 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:29:05.934333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:05.934333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:05.934333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:05.934333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:05.934333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:05.934333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:05.934333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:05.934333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:05.934333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:05.934333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:05.934333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:05.934333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:05.934333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:05.934333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:05.934333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:05.936405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:05.936405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:05.936405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:05.936405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:05.936405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:05.936405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:05.936405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:05.936405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:05.936405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:05.936405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:05.936405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:05.936405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:05.936405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:05.936405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:05.936405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:05.936405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:05.938133 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:05.938133 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:05.938133 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:05.938133 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:05.938133 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:05.938133 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:05.938133 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:05.938133 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:05.938133 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:05.938133 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:05.938133 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:29:05.938133 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:05.938133 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 224/444] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 20:29:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:05.938133 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3376791-f3d5-4316-bd55-c0b3d720f529 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:05.947190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd0236-9175-45a7-af83-1445db197bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:05.948196 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd0236-9175-45a7-af83-1445db197bff None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:05.948646 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd0236-9175-45a7-af83-1445db197bff None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:05.949087 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd0236-9175-45a7-af83-1445db197bff None admin] PATH_INFO: `/v3/groups/e386b3b088094609bd1c524d30752a9f` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:05.950986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd0236-9175-45a7-af83-1445db197bff None admin] RBAC: Authorizing `identity:get_group(group_id=e386b3b088094609bd1c524d30752a9f)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:05.953870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd0236-9175-45a7-af83-1445db197bff None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:05.961258 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 221/445] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 20:29:05 2022] GET /identity/v3/groups/e386b3b088094609bd1c524d30752a9f => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:05.961258 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd0236-9175-45a7-af83-1445db197bff None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:05.963646 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:06.039579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:06.060118 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3376791-f3d5-4316-bd55-c0b3d720f529 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:06.083208 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd0236-9175-45a7-af83-1445db197bff None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:06.099351 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb951ff9-50e5-4f5d-a293-b8758d3d570d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:06.100002 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb951ff9-50e5-4f5d-a293-b8758d3d570d None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:06.100282 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb951ff9-50e5-4f5d-a293-b8758d3d570d None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:06.100564 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb951ff9-50e5-4f5d-a293-b8758d3d570d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:06.124476 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa88636-6dc8-4804-90b3-9fb7105bef0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:06.125432 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa88636-6dc8-4804-90b3-9fb7105bef0a None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:06.125742 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa88636-6dc8-4804-90b3-9fb7105bef0a None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:06.126079 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa88636-6dc8-4804-90b3-9fb7105bef0a None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:06.127182 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa88636-6dc8-4804-90b3-9fb7105bef0a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:06.127712 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa88636-6dc8-4804-90b3-9fb7105bef0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:06.130093 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa88636-6dc8-4804-90b3-9fb7105bef0a None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:06.140544 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 222/446] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:06.141558 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa88636-6dc8-4804-90b3-9fb7105bef0a None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:06.182146 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb951ff9-50e5-4f5d-a293-b8758d3d570d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:06.183687 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb951ff9-50e5-4f5d-a293-b8758d3d570d None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:06.220108 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:06.257107 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa88636-6dc8-4804-90b3-9fb7105bef0a None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:06.270643 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:06.293448 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 225/447] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:29:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:29:06.293731 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b4f9b-4ce3-4589-b84b-426c55534d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:06.294332 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b4f9b-4ce3-4589-b84b-426c55534d08 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:06.294613 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b4f9b-4ce3-4589-b84b-426c55534d08 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:06.294792 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb951ff9-50e5-4f5d-a293-b8758d3d570d None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:06.294960 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b4f9b-4ce3-4589-b84b-426c55534d08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:06.295763 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b4f9b-4ce3-4589-b84b-426c55534d08 None admin] RBAC: Adding query filter params (group.id=e386b3b088094609bd1c524d30752a9f, role.id=910e8004690649e3b4fc1c4be76ad967, scope.project.id=45f63f10100747b9b9eaf0e3e8021980) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:06.296064 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b4f9b-4ce3-4589-b84b-426c55534d08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:06.297529 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b4f9b-4ce3-4589-b84b-426c55534d08 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:06.305884 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 223/448] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Aug 22 20:29:06 2022] GET /identity/v3/role_assignments?group.id=e386b3b088094609bd1c524d30752a9f&scope.project.id=45f63f10100747b9b9eaf0e3e8021980&role.id=910e8004690649e3b4fc1c4be76ad967 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:06.306711 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b4f9b-4ce3-4589-b84b-426c55534d08 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:06.453165 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb951ff9-50e5-4f5d-a293-b8758d3d570d None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:06.454761 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b4f9b-4ce3-4589-b84b-426c55534d08 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:06.489058 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:06.495714 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67aef4-5685-4ad7-b2cb-f7af9a0a166a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:06.499442 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676901a-5f78-4a9f-b042-da4d2f75d011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:06.499607 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67aef4-5685-4ad7-b2cb-f7af9a0a166a None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:06.499703 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676901a-5f78-4a9f-b042-da4d2f75d011 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:06.499774 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67aef4-5685-4ad7-b2cb-f7af9a0a166a None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:06.499932 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676901a-5f78-4a9f-b042-da4d2f75d011 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:06.500004 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67aef4-5685-4ad7-b2cb-f7af9a0a166a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:06.500069 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676901a-5f78-4a9f-b042-da4d2f75d011 None admin] PATH_INFO: `/v3/projects/41d17f0c019c419fa2ba2277c76a76b5` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:06.500069 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676901a-5f78-4a9f-b042-da4d2f75d011 None admin] RBAC: Authorizing `identity:get_project(project_id=41d17f0c019c419fa2ba2277c76a76b5)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:06.500197 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676901a-5f78-4a9f-b042-da4d2f75d011 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:06.506919 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 224/449] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:29:06 2022] GET /identity/v3/projects/41d17f0c019c419fa2ba2277c76a76b5 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:06.507808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676901a-5f78-4a9f-b042-da4d2f75d011 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:06.556148 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:06.579922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67aef4-5685-4ad7-b2cb-f7af9a0a166a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:06.581700 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67aef4-5685-4ad7-b2cb-f7af9a0a166a None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:06.641811 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676901a-5f78-4a9f-b042-da4d2f75d011 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:06.681648 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511786e-444a-4a1c-b199-cc3cbce9745a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:06.682441 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511786e-444a-4a1c-b199-cc3cbce9745a None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:06.682795 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511786e-444a-4a1c-b199-cc3cbce9745a None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:06.683080 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511786e-444a-4a1c-b199-cc3cbce9745a None admin] PATH_INFO: `/v3/groups/73f34a58e16c4627aba449239ba3847c` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:06.687527 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511786e-444a-4a1c-b199-cc3cbce9745a None admin] RBAC: Authorizing `identity:get_group(group_id=73f34a58e16c4627aba449239ba3847c)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:06.688568 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511786e-444a-4a1c-b199-cc3cbce9745a None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:06.690929 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 225/450] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 20:29:06 2022] GET /identity/v3/groups/73f34a58e16c4627aba449239ba3847c => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:06.696803 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511786e-444a-4a1c-b199-cc3cbce9745a None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:06.713592 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 226/451] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:29:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:29:06.719932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67aef4-5685-4ad7-b2cb-f7af9a0a166a None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:06.785354 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:06.816567 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:06.821168 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511786e-444a-4a1c-b199-cc3cbce9745a None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:06.837611 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67aef4-5685-4ad7-b2cb-f7af9a0a166a None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:06.858872 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb98d3f-ea87-457f-b866-21ef469d516b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:06.860534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb98d3f-ea87-457f-b866-21ef469d516b None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:06.860534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb98d3f-ea87-457f-b866-21ef469d516b None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:06.860534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb98d3f-ea87-457f-b866-21ef469d516b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:06.861623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb98d3f-ea87-457f-b866-21ef469d516b None admin] RBAC: Adding query filter params (group.id=73f34a58e16c4627aba449239ba3847c, role.id=1e3ce9c8b9934a7bb515b39e21fc1d68, scope.project.id=41d17f0c019c419fa2ba2277c76a76b5) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:06.861967 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb98d3f-ea87-457f-b866-21ef469d516b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:06.863816 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb98d3f-ea87-457f-b866-21ef469d516b None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:06.870386 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 226/452] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Aug 22 20:29:06 2022] GET /identity/v3/role_assignments?group.id=73f34a58e16c4627aba449239ba3847c&scope.project.id=41d17f0c019c419fa2ba2277c76a76b5&role.id=1e3ce9c8b9934a7bb515b39e21fc1d68 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:06.875260 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ac4d3-be12-4dde-bf28-6529ff69988f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:06.875944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ac4d3-be12-4dde-bf28-6529ff69988f None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:06.876219 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ac4d3-be12-4dde-bf28-6529ff69988f None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:06.876491 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ac4d3-be12-4dde-bf28-6529ff69988f None admin] PATH_INFO: `/v3/projects/45f63f10100747b9b9eaf0e3e8021980` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:06.877766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ac4d3-be12-4dde-bf28-6529ff69988f None admin] RBAC: Authorizing `identity:get_project(project_id=45f63f10100747b9b9eaf0e3e8021980)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:06.879257 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ac4d3-be12-4dde-bf28-6529ff69988f None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:06.881887 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 227/453] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 20:29:06 2022] GET /identity/v3/projects/45f63f10100747b9b9eaf0e3e8021980 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:06.887712 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb98d3f-ea87-457f-b866-21ef469d516b None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:07.010528 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb98d3f-ea87-457f-b866-21ef469d516b None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:07.045149 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:07.052105 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443bf3a-50a2-4144-90a0-ba387e63fa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:07.052766 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443bf3a-50a2-4144-90a0-ba387e63fa66 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:07.053050 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443bf3a-50a2-4144-90a0-ba387e63fa66 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:07.053324 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443bf3a-50a2-4144-90a0-ba387e63fa66 None admin] PATH_INFO: `/v3/groups/e386b3b088094609bd1c524d30752a9f` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:07.054621 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443bf3a-50a2-4144-90a0-ba387e63fa66 None admin] RBAC: Authorizing `identity:get_group(group_id=e386b3b088094609bd1c524d30752a9f)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:07.056140 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443bf3a-50a2-4144-90a0-ba387e63fa66 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:07.057760 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 227/454] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 20:29:06 2022] GET /identity/v3/groups/e386b3b088094609bd1c524d30752a9f => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:07.064653 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ac4d3-be12-4dde-bf28-6529ff69988f None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:07.176799 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ac4d3-be12-4dde-bf28-6529ff69988f None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:07.211191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1664ff6-b28a-4988-927b-85e9b935139e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:07.211842 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1664ff6-b28a-4988-927b-85e9b935139e None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:07.212126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1664ff6-b28a-4988-927b-85e9b935139e None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:07.212400 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1664ff6-b28a-4988-927b-85e9b935139e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:07.213140 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1664ff6-b28a-4988-927b-85e9b935139e None admin] RBAC: Adding query filter params (group.id=e386b3b088094609bd1c524d30752a9f, role.id=fcd9a48e6c4b4c048380a57be435c3dd, scope.project.id=45f63f10100747b9b9eaf0e3e8021980) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:07.213451 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1664ff6-b28a-4988-927b-85e9b935139e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:07.214908 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1664ff6-b28a-4988-927b-85e9b935139e None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:07.221793 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 228/455] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Aug 22 20:29:07 2022] GET /identity/v3/role_assignments?group.id=e386b3b088094609bd1c524d30752a9f&scope.project.id=45f63f10100747b9b9eaf0e3e8021980&role.id=fcd9a48e6c4b4c048380a57be435c3dd => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:10.192227 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7c581-99f9-433b-ab06-bb1c2431c723 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:10.193009 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7c581-99f9-433b-ab06-bb1c2431c723 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:10.193443 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7c581-99f9-433b-ab06-bb1c2431c723 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:10.195723 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 228/456] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:10.202007 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9316f94-0d51-4d64-9ab1-a6c6311d3035 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:10.203342 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9316f94-0d51-4d64-9ab1-a6c6311d3035 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:10.204079 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9316f94-0d51-4d64-9ab1-a6c6311d3035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:10.235188 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-b9316f94-0d51-4d64-9ab1-a6c6311d3035 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:10.237705 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-b9316f94-0d51-4d64-9ab1-a6c6311d3035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:10.253198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:10.372876 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 229/457] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:29:10.715941 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b470ef0-2c16-463f-87ff-0d4650a18c30 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:10.716970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b470ef0-2c16-463f-87ff-0d4650a18c30 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:10.718308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b470ef0-2c16-463f-87ff-0d4650a18c30 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:10.721501 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 229/458] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:10.727116 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598add45-3fc7-422a-bdb4-1f750631e252 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:10.727782 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598add45-3fc7-422a-bdb4-1f750631e252 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:10.728369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598add45-3fc7-422a-bdb4-1f750631e252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:10.750295 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-598add45-3fc7-422a-bdb4-1f750631e252 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:10.752655 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-598add45-3fc7-422a-bdb4-1f750631e252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:10.768394 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b470ef0-2c16-463f-87ff-0d4650a18c30 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:10.870823 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 230/459] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:29:10.929953 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b470ef0-2c16-463f-87ff-0d4650a18c30 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:10.969296 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a09a7-c0af-4c3e-803f-6e2b0efa8fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:10.970217 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a09a7-c0af-4c3e-803f-6e2b0efa8fa5 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:10.970642 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a09a7-c0af-4c3e-803f-6e2b0efa8fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:10.971057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a09a7-c0af-4c3e-803f-6e2b0efa8fa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:10.983568 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a09a7-c0af-4c3e-803f-6e2b0efa8fa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:10.985395 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a09a7-c0af-4c3e-803f-6e2b0efa8fa5 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:11.003732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-364a09a7-c0af-4c3e-803f-6e2b0efa8fa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:11.003732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:11.003732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:11.003732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:11.003732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:11.003732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:11.003732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:11.003732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:11.003732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:11.003732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:11.003732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:11.003732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:11.003732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:11.003732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:11.003732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:11.003732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:11.004843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:11.004843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:11.004843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:11.004843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:11.004843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:11.004843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:11.004843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:11.004843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:11.004843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:11.004843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:11.004843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:11.004843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:11.004843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:11.004843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:11.004843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:11.004843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:11.004843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:11.005816 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:11.005816 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:11.005816 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:11.007763 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 230/460] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:29:11.017498 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598add45-3fc7-422a-bdb4-1f750631e252 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:11.098074 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:11.130923 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598add45-3fc7-422a-bdb4-1f750631e252 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:11.170270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255facec-a697-401e-b3cc-8747f55d8576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:11.170928 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255facec-a697-401e-b3cc-8747f55d8576 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:11.171210 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255facec-a697-401e-b3cc-8747f55d8576 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:11.171489 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255facec-a697-401e-b3cc-8747f55d8576 None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:11.172175 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255facec-a697-401e-b3cc-8747f55d8576 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:11.172533 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255facec-a697-401e-b3cc-8747f55d8576 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:11.173940 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255facec-a697-401e-b3cc-8747f55d8576 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:11.175838 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383ffc3-a0c8-4c14-8093-bc5fd281811b None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:11.176380 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383ffc3-a0c8-4c14-8093-bc5fd281811b None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:11.176856 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383ffc3-a0c8-4c14-8093-bc5fd281811b None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:11.178422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 231/461] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:11.184445 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81707d53-1127-464b-a8df-c0b961170bc6 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:11.185297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81707d53-1127-464b-a8df-c0b961170bc6 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:11.185793 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81707d53-1127-464b-a8df-c0b961170bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:11.188199 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 231/462] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:11.193875 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255facec-a697-401e-b3cc-8747f55d8576 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:11.211095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-81707d53-1127-464b-a8df-c0b961170bc6 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:11.213346 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-81707d53-1127-464b-a8df-c0b961170bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:11.274251 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:11.298531 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 232/463] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:29:11.327834 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81707d53-1127-464b-a8df-c0b961170bc6 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:11.329344 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255facec-a697-401e-b3cc-8747f55d8576 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:11.372004 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:11.382684 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7601741-5207-4172-bbb0-45476f02a6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:11.383239 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7601741-5207-4172-bbb0-45476f02a6dd None admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:11.383731 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7601741-5207-4172-bbb0-45476f02a6dd None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:11.384306 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7601741-5207-4172-bbb0-45476f02a6dd None admin] PATH_INFO: `/v3/users` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:11.385028 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7601741-5207-4172-bbb0-45476f02a6dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:11.387228 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7601741-5207-4172-bbb0-45476f02a6dd None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:11.479212 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81707d53-1127-464b-a8df-c0b961170bc6 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:11.511591 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 232/464] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 20:29:11 2022] POST /identity/v3/users => generated 246 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:29:11.511591 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b745a8-fd55-48f7-b65a-ad771e9622c1 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:11.511591 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b745a8-fd55-48f7-b65a-ad771e9622c1 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:11.511591 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b745a8-fd55-48f7-b65a-ad771e9622c1 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:11.511591 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 233/465] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:11.520222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475eff8-b2f8-4629-b6ce-b38de120f093 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:11.520995 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475eff8-b2f8-4629-b6ce-b38de120f093 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:11.521592 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475eff8-b2f8-4629-b6ce-b38de120f093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:11.550588 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b6504-7727-4b1c-8a16-a2d9a9752b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:11.551474 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b6504-7727-4b1c-8a16-a2d9a9752b18 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:11.551984 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b6504-7727-4b1c-8a16-a2d9a9752b18 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:11.552516 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b6504-7727-4b1c-8a16-a2d9a9752b18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:11.554816 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-d475eff8-b2f8-4629-b6ce-b38de120f093 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:11.558169 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-d475eff8-b2f8-4629-b6ce-b38de120f093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:11.568973 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b6504-7727-4b1c-8a16-a2d9a9752b18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:11.570708 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b6504-7727-4b1c-8a16-a2d9a9752b18 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:11.590579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-f37b6504-7727-4b1c-8a16-a2d9a9752b18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:11.590579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:11.590579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:11.590579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:11.590579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:11.590579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:11.590579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:11.590579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:11.590579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:11.590579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:11.590579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:11.590579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:11.590579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:11.590579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:11.590579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:11.590579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:11.592272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:11.592272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:11.592272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:11.592272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:11.592272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:11.592272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:11.592272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:11.592272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:11.592272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:11.592272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:11.592272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:11.592272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:11.592272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:11.592272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:11.592272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:11.592272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:11.592272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:11.599454 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:11.599454 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:11.599454 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:11.599454 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 233/466] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:11.605029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b6504-7727-4b1c-8a16-a2d9a9752b18 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:11.669879 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:11.703442 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 234/467] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:29:11.704939 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475eff8-b2f8-4629-b6ce-b38de120f093 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:11.786021 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b6504-7727-4b1c-8a16-a2d9a9752b18 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:11.866456 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bccd5-459b-4d5c-8b8b-e3e4caec915b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:11.868070 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bccd5-459b-4d5c-8b8b-e3e4caec915b None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:11.868838 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bccd5-459b-4d5c-8b8b-e3e4caec915b None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:11.869544 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bccd5-459b-4d5c-8b8b-e3e4caec915b None admin] PATH_INFO: `/v3/domains` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:11.870752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430bccd5-459b-4d5c-8b8b-e3e4caec915b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:11.871322 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430bccd5-459b-4d5c-8b8b-e3e4caec915b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:11.874502 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430bccd5-459b-4d5c-8b8b-e3e4caec915b None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:11.905994 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 234/468] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:11.912005 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475eff8-b2f8-4629-b6ce-b38de120f093 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:11.914903 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bccd5-459b-4d5c-8b8b-e3e4caec915b None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:11.950834 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:11.988787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33f70e-115f-4498-907a-8e81544413c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:11.992973 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33f70e-115f-4498-907a-8e81544413c5 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:11.994464 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33f70e-115f-4498-907a-8e81544413c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:11.995102 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33f70e-115f-4498-907a-8e81544413c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:12.035327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33f70e-115f-4498-907a-8e81544413c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:12.038267 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33f70e-115f-4498-907a-8e81544413c5 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:12.065751 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-4a33f70e-115f-4498-907a-8e81544413c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:12.065751 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:12.065751 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:12.065751 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:12.065751 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:12.065751 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:12.065751 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:12.065751 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:12.065751 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:12.065751 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:12.065751 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:12.065751 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:12.065751 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:12.065751 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:12.065751 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:12.065751 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:12.067531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:12.067531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:12.067531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:12.067531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:12.067531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:12.067531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:12.067531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:12.067531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:12.067531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:12.067531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:12.067531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:12.067531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:12.067531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:12.067531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:12.067531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:12.067531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:12.067531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:12.069181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:12.069181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:12.069181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:12.070059 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 235/469] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:12.073095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33f70e-115f-4498-907a-8e81544413c5 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:12.108994 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:12.124490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bccd5-459b-4d5c-8b8b-e3e4caec915b None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:12.173832 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4579d44-704e-42ea-9320-a503b3361145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:12.174720 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4579d44-704e-42ea-9320-a503b3361145 None admin] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:12.175146 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4579d44-704e-42ea-9320-a503b3361145 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:12.175605 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4579d44-704e-42ea-9320-a503b3361145 None admin] PATH_INFO: `/v3/users` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:12.176501 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4579d44-704e-42ea-9320-a503b3361145 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:12.178038 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4579d44-704e-42ea-9320-a503b3361145 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:12.216661 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33f70e-115f-4498-907a-8e81544413c5 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:12.251730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341955e-b1d1-4e3f-be66-e6a72a5caa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:12.252393 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341955e-b1d1-4e3f-be66-e6a72a5caa60 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:12.252671 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341955e-b1d1-4e3f-be66-e6a72a5caa60 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:12.252943 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341955e-b1d1-4e3f-be66-e6a72a5caa60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:12.263959 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341955e-b1d1-4e3f-be66-e6a72a5caa60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:12.265934 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341955e-b1d1-4e3f-be66-e6a72a5caa60 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:12.280662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-e341955e-b1d1-4e3f-be66-e6a72a5caa60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:12.280662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:12.280662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:12.280662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:12.280662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:12.280662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:12.280662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:12.280662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:12.280662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:12.280662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:12.280662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:12.280662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:12.280662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:12.280662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:12.280662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:12.280662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:12.281576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:12.281576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:12.281576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:12.281576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:12.281576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:12.281576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:12.281576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:12.281576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:12.281576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:12.281576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:12.281576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:12.281576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:12.281576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:12.281576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:12.281576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:12.281576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:12.281576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:12.282442 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:12.282442 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:12.282442 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:12.282442 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 236/470] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:12.282651 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341955e-b1d1-4e3f-be66-e6a72a5caa60 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:12.307704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 235/471] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 20:29:11 2022] POST /identity/v3/users => generated 248 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:29:12.307704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4579d44-704e-42ea-9320-a503b3361145 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:12.322502 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:12.422762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341955e-b1d1-4e3f-be66-e6a72a5caa60 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:12.464502 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4579d44-704e-42ea-9320-a503b3361145 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:12.465187 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1ec4a-b6bf-4ebc-a2a8-1ecb867fda8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:12.465824 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1ec4a-b6bf-4ebc-a2a8-1ecb867fda8f None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:12.466156 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1ec4a-b6bf-4ebc-a2a8-1ecb867fda8f None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:12.466370 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1ec4a-b6bf-4ebc-a2a8-1ecb867fda8f None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:12.467115 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1ec4a-b6bf-4ebc-a2a8-1ecb867fda8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:12.467350 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1ec4a-b6bf-4ebc-a2a8-1ecb867fda8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:12.468974 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1ec4a-b6bf-4ebc-a2a8-1ecb867fda8f None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:12.487406 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 237/472] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:12.488425 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1ec4a-b6bf-4ebc-a2a8-1ecb867fda8f None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:12.511746 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f299df-befa-49b3-8d9b-f08f7ffcd2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:12.512882 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f299df-befa-49b3-8d9b-f08f7ffcd2ab None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:12.512882 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f299df-befa-49b3-8d9b-f08f7ffcd2ab None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:12.513064 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f299df-befa-49b3-8d9b-f08f7ffcd2ab None admin] PATH_INFO: `/v3/domains` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:12.513655 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f299df-befa-49b3-8d9b-f08f7ffcd2ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:12.513959 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f299df-befa-49b3-8d9b-f08f7ffcd2ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:12.516136 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f299df-befa-49b3-8d9b-f08f7ffcd2ab None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:12.537648 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 236/473] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:12.544688 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f299df-befa-49b3-8d9b-f08f7ffcd2ab None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:12.556906 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:12.616161 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:12.659920 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1ec4a-b6bf-4ebc-a2a8-1ecb867fda8f None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:12.683887 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f299df-befa-49b3-8d9b-f08f7ffcd2ab None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:12.713017 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51a781-802b-47a2-8d93-3c589bc9a15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:12.713666 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51a781-802b-47a2-8d93-3c589bc9a15c None admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:12.713991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51a781-802b-47a2-8d93-3c589bc9a15c None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:12.714275 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51a781-802b-47a2-8d93-3c589bc9a15c None admin] PATH_INFO: `/v3/users` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:12.714944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51a781-802b-47a2-8d93-3c589bc9a15c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:12.716501 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51a781-802b-47a2-8d93-3c589bc9a15c None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:12.754165 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1daa627-db2d-4015-97d2-5e9ddc549613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:12.755102 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daa627-db2d-4015-97d2-5e9ddc549613 None admin] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:12.755642 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daa627-db2d-4015-97d2-5e9ddc549613 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:12.756140 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daa627-db2d-4015-97d2-5e9ddc549613 None admin] PATH_INFO: `/v3/users` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:12.757319 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1daa627-db2d-4015-97d2-5e9ddc549613 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:12.762661 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1daa627-db2d-4015-97d2-5e9ddc549613 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:12.822200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 238/474] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 20:29:12 2022] POST /identity/v3/users => generated 248 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:29:12.864319 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 237/475] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 20:29:12 2022] POST /identity/v3/users => generated 249 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:29:15.087843 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f28787-821f-4805-9e7f-8faf18a15894 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:15.088378 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f28787-821f-4805-9e7f-8faf18a15894 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:15.088378 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f28787-821f-4805-9e7f-8faf18a15894 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:15.090435 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 239/476] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:15.096361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40a225-6114-4c9b-b92b-77ce7b17d7de None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:15.096884 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40a225-6114-4c9b-b92b-77ce7b17d7de None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:15.096957 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40a225-6114-4c9b-b92b-77ce7b17d7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:15.117202 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-0f40a225-6114-4c9b-b92b-77ce7b17d7de None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:15.118514 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-0f40a225-6114-4c9b-b92b-77ce7b17d7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:15.121666 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641f71b-5209-453b-a806-ec3984963d84 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:15.122169 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641f71b-5209-453b-a806-ec3984963d84 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:15.122653 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641f71b-5209-453b-a806-ec3984963d84 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:15.126101 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 240/477] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:15.134977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cce96-1070-48a4-acdb-57db63a1f5d9 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:15.135482 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cce96-1070-48a4-acdb-57db63a1f5d9 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:15.136032 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cce96-1070-48a4-acdb-57db63a1f5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:15.172600 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-b16cce96-1070-48a4-acdb-57db63a1f5d9 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:15.175486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-b16cce96-1070-48a4-acdb-57db63a1f5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:15.189870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:15.199205 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 238/478] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:29:15.267660 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 241/479] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:29:15.546660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40a225-6114-4c9b-b92b-77ce7b17d7de None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:15.615956 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cce96-1070-48a4-acdb-57db63a1f5d9 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:15.696974 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40a225-6114-4c9b-b92b-77ce7b17d7de None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:15.710569 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:15.740822 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647d8b2-afbb-4fca-b1ce-e729293f8b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:15.741471 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647d8b2-afbb-4fca-b1ce-e729293f8b04 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:15.741746 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647d8b2-afbb-4fca-b1ce-e729293f8b04 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:15.742016 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647d8b2-afbb-4fca-b1ce-e729293f8b04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:15.755717 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647d8b2-afbb-4fca-b1ce-e729293f8b04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:15.755937 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cce96-1070-48a4-acdb-57db63a1f5d9 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:15.760669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-1647d8b2-afbb-4fca-b1ce-e729293f8b04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:15.760669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:15.760669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:15.760669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:15.760669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:15.760669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:15.760669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:15.760669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:15.760669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:15.760669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:15.760669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:15.760669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:15.760669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:15.760669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:15.760669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:15.760669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:15.761682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:15.761682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:15.761682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:15.761682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:15.761682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:15.761682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:15.761682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:15.761682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:15.761682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:15.761682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:15.761682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:15.761682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:15.761682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:15.761682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:15.761682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:15.761682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:15.762641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:15.762641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:15.762641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:15.762641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:15.762641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:15.762641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:15.762641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:15.762641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:15.762641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:15.762641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:15.762641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:15.762641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:15.767655 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 239/480] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 20:29:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:15.768838 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c0532-ff39-4e46-b398-0e1aef62f6e6 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:15.769127 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c0532-ff39-4e46-b398-0e1aef62f6e6 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:15.769403 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c0532-ff39-4e46-b398-0e1aef62f6e6 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:15.771046 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 240/481] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:15.771672 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c0532-ff39-4e46-b398-0e1aef62f6e6 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:15.804327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4e531-a225-43e7-99b3-215fd32bb724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:15.805373 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4e531-a225-43e7-99b3-215fd32bb724 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:15.805835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4e531-a225-43e7-99b3-215fd32bb724 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:15.806387 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4e531-a225-43e7-99b3-215fd32bb724 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:15.821216 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4e531-a225-43e7-99b3-215fd32bb724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:15.827952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-87c4e531-a225-43e7-99b3-215fd32bb724 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:15.827952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:15.827952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:15.827952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:15.827952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:15.827952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:15.827952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:15.827952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:15.827952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:15.827952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:15.827952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:15.827952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:15.827952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:15.827952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:15.827952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:15.827952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:15.829001 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:15.829001 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:15.829001 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:15.829001 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:15.829001 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:15.829001 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:15.829001 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:15.829001 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:15.829001 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:15.829001 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:15.829001 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:15.829001 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:15.829001 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:15.829001 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:15.829001 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:15.829001 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:15.829821 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:15.829821 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:15.829821 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:15.829821 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:15.829821 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:15.829821 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:15.829821 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:15.829821 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:15.829821 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:15.829821 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:15.829821 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:15.829821 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:15.829821 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 242/482] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 20:29:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:29:15.830537 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac37e66-bad7-4a75-a741-35f04667bdd0 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:15.830602 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac37e66-bad7-4a75-a741-35f04667bdd0 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:15.830861 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac37e66-bad7-4a75-a741-35f04667bdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:15.851157 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-cac37e66-bad7-4a75-a741-35f04667bdd0 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:15.852457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-cac37e66-bad7-4a75-a741-35f04667bdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:15.855699 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:15.907379 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c0532-ff39-4e46-b398-0e1aef62f6e6 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:15.953925 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a820dc-a7b9-4401-b12f-2d54b81c044f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:15.960005 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 243/483] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:29:15.960113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a820dc-a7b9-4401-b12f-2d54b81c044f None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:15.960113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a820dc-a7b9-4401-b12f-2d54b81c044f None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:15.960113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a820dc-a7b9-4401-b12f-2d54b81c044f None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:15.960321 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac37e66-bad7-4a75-a741-35f04667bdd0 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:15.960391 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a820dc-a7b9-4401-b12f-2d54b81c044f None admin] RBAC: Adding query filter params (name=service) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:15.960391 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a820dc-a7b9-4401-b12f-2d54b81c044f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:15.960391 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a820dc-a7b9-4401-b12f-2d54b81c044f None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:15.977020 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 241/484] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 20:29:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:15.978637 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a820dc-a7b9-4401-b12f-2d54b81c044f None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:16.024976 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:16.080167 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac37e66-bad7-4a75-a741-35f04667bdd0 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:16.121765 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e2af2-5098-45e1-8baf-88ca8bd1f6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:16.123257 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e2af2-5098-45e1-8baf-88ca8bd1f6aa None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:16.124424 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e2af2-5098-45e1-8baf-88ca8bd1f6aa None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:16.124888 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e2af2-5098-45e1-8baf-88ca8bd1f6aa None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:16.125759 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e2af2-5098-45e1-8baf-88ca8bd1f6aa None admin] RBAC: Adding query filter params (name=service) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:16.126243 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e2af2-5098-45e1-8baf-88ca8bd1f6aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:16.127971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e2af2-5098-45e1-8baf-88ca8bd1f6aa None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:16.132059 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a820dc-a7b9-4401-b12f-2d54b81c044f None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:16.143587 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 244/485] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 20:29:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:16.145002 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e2af2-5098-45e1-8baf-88ca8bd1f6aa None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:16.155807 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:16.180550 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35bb3c-f25b-495d-8118-883afcf546c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:16.181524 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35bb3c-f25b-495d-8118-883afcf546c9 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:16.182101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35bb3c-f25b-495d-8118-883afcf546c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:16.182520 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35bb3c-f25b-495d-8118-883afcf546c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:16.198421 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35bb3c-f25b-495d-8118-883afcf546c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:16.200602 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35bb3c-f25b-495d-8118-883afcf546c9 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:16.226948 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-af35bb3c-f25b-495d-8118-883afcf546c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:16.226948 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:16.226948 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:16.226948 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:16.226948 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:16.226948 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:16.226948 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:16.226948 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:16.226948 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:16.226948 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:16.226948 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:16.226948 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:16.226948 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:16.226948 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:16.226948 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:16.226948 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:16.227962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:16.227962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:16.227962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:16.227962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:16.227962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:16.227962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:16.227962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:16.227962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:16.227962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:16.227962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:16.227962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:16.227962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:16.227962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:16.227962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:16.227962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:16.227962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:16.227962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:16.228823 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:16.228823 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:16.228823 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:16.229540 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 242/486] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:29:16.242162 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35bb3c-f25b-495d-8118-883afcf546c9 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:16.263343 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e2af2-5098-45e1-8baf-88ca8bd1f6aa None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:16.288463 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:16.304799 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70800fea-4c3d-4407-b783-e9dd056c08b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:16.305689 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70800fea-4c3d-4407-b783-e9dd056c08b1 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:16.306119 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70800fea-4c3d-4407-b783-e9dd056c08b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:16.306557 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70800fea-4c3d-4407-b783-e9dd056c08b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:16.321027 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70800fea-4c3d-4407-b783-e9dd056c08b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:16.322856 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70800fea-4c3d-4407-b783-e9dd056c08b1 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:16.339685 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-70800fea-4c3d-4407-b783-e9dd056c08b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:16.339685 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:16.339685 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:16.339685 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:16.339685 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:16.339685 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:16.339685 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:16.339685 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:16.339685 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:16.339685 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:16.339685 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:16.339685 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:16.339685 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:16.339685 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:16.339685 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:16.339685 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:16.340740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:16.340740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:16.340740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:16.340740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:16.340740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:16.340740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:16.340740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:16.340740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:16.340740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:16.340740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:16.340740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:16.340740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:16.340740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:16.340740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:16.340740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:16.340740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:16.340740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:16.341740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:16.341740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:16.341740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:16.347995 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 245/487] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:16.350969 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ae283-a32b-480b-98f1-f831c8ceb88d None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:16.351476 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ae283-a32b-480b-98f1-f831c8ceb88d None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:16.351901 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ae283-a32b-480b-98f1-f831c8ceb88d None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:16.358126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 246/488] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:16.358126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ae283-a32b-480b-98f1-f831c8ceb88d None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:16.415408 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35bb3c-f25b-495d-8118-883afcf546c9 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:16.455137 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b258bd-bce7-4a57-9c59-f19e711bf83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:16.455779 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b258bd-bce7-4a57-9c59-f19e711bf83d None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:16.456063 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b258bd-bce7-4a57-9c59-f19e711bf83d None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:16.456337 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b258bd-bce7-4a57-9c59-f19e711bf83d None admin] PATH_INFO: `/v3/domains` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:16.457011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b258bd-bce7-4a57-9c59-f19e711bf83d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:16.457307 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b258bd-bce7-4a57-9c59-f19e711bf83d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:16.458702 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b258bd-bce7-4a57-9c59-f19e711bf83d None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:16.476015 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 243/489] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:16.476015 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62ecd3-3ffa-4021-91da-8875cc72bbc1 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:16.476015 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62ecd3-3ffa-4021-91da-8875cc72bbc1 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:16.476015 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62ecd3-3ffa-4021-91da-8875cc72bbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:16.476660 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ae283-a32b-480b-98f1-f831c8ceb88d None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:16.492500 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-9b62ecd3-3ffa-4021-91da-8875cc72bbc1 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:16.493735 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-9b62ecd3-3ffa-4021-91da-8875cc72bbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:16.516430 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7138e92-459a-430b-9b71-6082d057df00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:16.517232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7138e92-459a-430b-9b71-6082d057df00 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:16.517578 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7138e92-459a-430b-9b71-6082d057df00 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:16.517948 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7138e92-459a-430b-9b71-6082d057df00 None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:16.518776 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7138e92-459a-430b-9b71-6082d057df00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:16.519089 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7138e92-459a-430b-9b71-6082d057df00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:16.520720 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7138e92-459a-430b-9b71-6082d057df00 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:16.521485 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:16.541113 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 247/490] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:16.541847 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7138e92-459a-430b-9b71-6082d057df00 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:16.577563 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:16.579890 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 244/491] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:29:16.580870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62ecd3-3ffa-4021-91da-8875cc72bbc1 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:16.666352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7138e92-459a-430b-9b71-6082d057df00 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:16.711032 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62ecd3-3ffa-4021-91da-8875cc72bbc1 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:16.720564 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8127fb-8358-4f94-adbe-36536c97d2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:16.721212 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8127fb-8358-4f94-adbe-36536c97d2fe None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:16.721494 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8127fb-8358-4f94-adbe-36536c97d2fe None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:16.721769 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8127fb-8358-4f94-adbe-36536c97d2fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:16.736114 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8127fb-8358-4f94-adbe-36536c97d2fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:16.740944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-db8127fb-8358-4f94-adbe-36536c97d2fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:16.740944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:16.740944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:16.740944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:16.740944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:16.740944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:16.740944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:16.740944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:16.740944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:16.740944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:16.740944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:16.740944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:16.740944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:16.740944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:16.740944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:16.740944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:16.742579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:16.742579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:16.742579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:16.742579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:16.742579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:16.742579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:16.742579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:16.742579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:16.742579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:16.742579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:16.742579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:16.742579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:16.742579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:16.742579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:16.742579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:16.742579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:16.743530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:16.743530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:16.743530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:16.743530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:16.743530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:16.743530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:16.743530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:16.743530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:16.743530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:16.743530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:16.743530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:16.743530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:16.746880 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 248/492] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 20:29:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:16.748023 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8127fb-8358-4f94-adbe-36536c97d2fe None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:16.754738 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9445d59-57a9-4844-ad72-d434a9ad9b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:16.755381 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9445d59-57a9-4844-ad72-d434a9ad9b6c None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:16.755716 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9445d59-57a9-4844-ad72-d434a9ad9b6c None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:16.755999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9445d59-57a9-4844-ad72-d434a9ad9b6c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:16.764780 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9445d59-57a9-4844-ad72-d434a9ad9b6c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:16.766357 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9445d59-57a9-4844-ad72-d434a9ad9b6c None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:16.781409 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-b9445d59-57a9-4844-ad72-d434a9ad9b6c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:29:16.781409 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:16.781409 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:16.781409 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:16.781409 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:16.781409 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:16.781409 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:16.781409 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:16.781409 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:16.781409 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:16.781409 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:16.781409 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:16.781409 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:29:16.781409 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:29:16.781409 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:29:16.781409 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:29:16.783361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:16.783361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:16.783361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:29:16.783361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:16.783361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:29:16.783361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:16.783361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:16.783361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:16.783361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:16.783361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:16.783361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:16.783361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:16.783361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:16.783361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:16.783361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:16.783361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:16.783361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:16.783361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:16.784973 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:16.784973 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:16.784973 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:29:16.784973 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:29:16.784973 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:29:16.784973 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:29:16.784973 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:29:16.784973 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:29:16.784973 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:29:16.784973 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:16.784973 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 245/493] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:29:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:16.784973 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9445d59-57a9-4844-ad72-d434a9ad9b6c None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:16.806468 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:16.874568 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:16.883628 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8127fb-8358-4f94-adbe-36536c97d2fe None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:16.917821 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9445d59-57a9-4844-ad72-d434a9ad9b6c None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:16.923454 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80339e36-17a0-42ed-9f80-59f7400707c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:16.924132 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80339e36-17a0-42ed-9f80-59f7400707c0 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:16.924480 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80339e36-17a0-42ed-9f80-59f7400707c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:16.924756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80339e36-17a0-42ed-9f80-59f7400707c0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:16.932725 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80339e36-17a0-42ed-9f80-59f7400707c0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:16.934211 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80339e36-17a0-42ed-9f80-59f7400707c0 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:16.949604 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-80339e36-17a0-42ed-9f80-59f7400707c0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:29:16.949604 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:16.949604 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:16.949604 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:16.949604 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:16.949604 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:16.949604 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:16.949604 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:16.949604 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:16.949604 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:16.949604 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:16.949604 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:16.949604 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:29:16.949604 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:29:16.949604 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:29:16.949604 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:29:16.950588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:16.950588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:16.950588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:29:16.950588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:16.950588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:29:16.950588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:16.950588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:16.950588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:16.950588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:16.950588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:16.950588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:16.950588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:16.950588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:16.950588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:16.950588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:16.950588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:16.950588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:16.950588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:16.951503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:16.951503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:16.951503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:29:16.951503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:29:16.951503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:29:16.951503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:29:16.951503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:29:16.951503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:29:16.951503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:29:16.951503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:16.951503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 249/494] 10.222.0.15 () {56 vars in 1093 bytes} [Mon Aug 22 20:29:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:16.951503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80339e36-17a0-42ed-9f80-59f7400707c0 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:16.967277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c0bd1-fa9d-4415-8a4a-acc07c8d0aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:16.968424 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c0bd1-fa9d-4415-8a4a-acc07c8d0aef None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:16.969319 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c0bd1-fa9d-4415-8a4a-acc07c8d0aef None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:16.969594 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c0bd1-fa9d-4415-8a4a-acc07c8d0aef None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:16.970271 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c0bd1-fa9d-4415-8a4a-acc07c8d0aef None admin] RBAC: Adding query filter params (name=service) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:16.970571 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c0bd1-fa9d-4415-8a4a-acc07c8d0aef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:16.972008 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c0bd1-fa9d-4415-8a4a-acc07c8d0aef None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:16.984409 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 246/495] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 20:29:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:16.985035 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c0bd1-fa9d-4415-8a4a-acc07c8d0aef None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:17.081389 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80339e36-17a0-42ed-9f80-59f7400707c0 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:17.083878 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:17.113280 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c0bd1-fa9d-4415-8a4a-acc07c8d0aef None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:17.135725 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b508c86-d5b1-4853-8e84-166899e82ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:17.136342 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b508c86-d5b1-4853-8e84-166899e82ec0 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:17.136626 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b508c86-d5b1-4853-8e84-166899e82ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:17.136904 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b508c86-d5b1-4853-8e84-166899e82ec0 None admin] PATH_INFO: `/v3/users` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:17.140816 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b508c86-d5b1-4853-8e84-166899e82ec0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:17.140816 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b508c86-d5b1-4853-8e84-166899e82ec0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:17.140816 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b508c86-d5b1-4853-8e84-166899e82ec0 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:17.158846 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d954160-e90d-499f-9eb4-70a73c240315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:17.159741 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d954160-e90d-499f-9eb4-70a73c240315 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:17.160025 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d954160-e90d-499f-9eb4-70a73c240315 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:17.160298 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d954160-e90d-499f-9eb4-70a73c240315 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:17.173277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d954160-e90d-499f-9eb4-70a73c240315 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:17.179067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-6d954160-e90d-499f-9eb4-70a73c240315 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:17.179067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:17.179067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:17.179067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:17.179067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:17.179067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:17.179067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:17.179067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:17.179067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:17.179067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:17.179067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:17.179067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:17.179067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:17.179067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:17.179067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:17.179067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:17.180229 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:17.180229 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:17.180229 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:17.180229 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:17.180229 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:17.180229 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:17.180229 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:17.180229 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:17.180229 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:17.180229 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:17.180229 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:17.180229 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:17.180229 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:17.180229 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:17.180229 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:17.180229 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:17.182196 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:17.182196 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:17.182196 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:17.182196 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:17.182196 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:17.182196 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:17.182196 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:17.182196 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:17.182196 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:17.182196 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:17.182196 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:17.182196 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:17.183063 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 250/496] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Aug 22 20:29:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:17.183063 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b508c86-d5b1-4853-8e84-166899e82ec0 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:17.183853 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 247/497] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 20:29:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:17.185935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d954160-e90d-499f-9eb4-70a73c240315 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:17.199386 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:17.299281 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b508c86-d5b1-4853-8e84-166899e82ec0 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:17.302665 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d954160-e90d-499f-9eb4-70a73c240315 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:17.334530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5636c-fddb-4dd1-86a5-901a7e9ea9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:17.335137 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5636c-fddb-4dd1-86a5-901a7e9ea9f5 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:17.335427 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5636c-fddb-4dd1-86a5-901a7e9ea9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:17.335716 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5636c-fddb-4dd1-86a5-901a7e9ea9f5 None admin] PATH_INFO: `/v3/users` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:17.336446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5636c-fddb-4dd1-86a5-901a7e9ea9f5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:17.336748 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5636c-fddb-4dd1-86a5-901a7e9ea9f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:17.338197 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5636c-fddb-4dd1-86a5-901a7e9ea9f5 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:17.356979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 251/498] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Aug 22 20:29:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:17.357836 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5636c-fddb-4dd1-86a5-901a7e9ea9f5 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:17.361166 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9de94a-bac2-49fd-9c49-9c3f7fcc3094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:17.361862 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9de94a-bac2-49fd-9c49-9c3f7fcc3094 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:17.362144 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9de94a-bac2-49fd-9c49-9c3f7fcc3094 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:17.362416 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9de94a-bac2-49fd-9c49-9c3f7fcc3094 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:17.372164 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:17.374495 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9de94a-bac2-49fd-9c49-9c3f7fcc3094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:17.376039 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9de94a-bac2-49fd-9c49-9c3f7fcc3094 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:17.391421 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-7f9de94a-bac2-49fd-9c49-9c3f7fcc3094 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:17.391421 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:17.391421 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:17.391421 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:17.391421 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:17.391421 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:17.391421 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:17.391421 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:17.391421 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:17.391421 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:17.391421 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:17.391421 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:17.391421 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:17.391421 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:17.391421 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:17.391421 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:17.392577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:17.392577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:17.392577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:17.392577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:17.392577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:17.392577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:17.392577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:17.392577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:17.392577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:17.392577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:17.392577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:17.392577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:17.392577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:17.392577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:17.392577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:17.392577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:17.392577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:17.393717 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:17.393717 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:17.393717 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:17.393717 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 248/499] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:17.393717 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9de94a-bac2-49fd-9c49-9c3f7fcc3094 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:17.454525 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:17.498948 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5636c-fddb-4dd1-86a5-901a7e9ea9f5 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:17.508047 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9de94a-bac2-49fd-9c49-9c3f7fcc3094 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:17.541793 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3314fcc-434d-4e3d-a1c6-ddf0df977c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:17.542403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3314fcc-434d-4e3d-a1c6-ddf0df977c4b None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:17.542684 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3314fcc-434d-4e3d-a1c6-ddf0df977c4b None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:17.542958 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3314fcc-434d-4e3d-a1c6-ddf0df977c4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:17.550478 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7c02b-9763-4071-83e1-040be482e1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:17.551095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7c02b-9763-4071-83e1-040be482e1d7 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:17.551377 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7c02b-9763-4071-83e1-040be482e1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:17.551693 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7c02b-9763-4071-83e1-040be482e1d7 None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:17.552369 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7c02b-9763-4071-83e1-040be482e1d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:17.552680 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7c02b-9763-4071-83e1-040be482e1d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:17.554096 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7c02b-9763-4071-83e1-040be482e1d7 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:17.564993 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 249/500] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 20:29:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:17.566169 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7c02b-9763-4071-83e1-040be482e1d7 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:17.626643 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:17.632919 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3314fcc-434d-4e3d-a1c6-ddf0df977c4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:17.636652 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3314fcc-434d-4e3d-a1c6-ddf0df977c4b None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:17.680978 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7c02b-9763-4071-83e1-040be482e1d7 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:17.720154 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a5883-1c06-4154-a8af-6cb1bfddf645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:17.720849 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a5883-1c06-4154-a8af-6cb1bfddf645 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:17.721262 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a5883-1c06-4154-a8af-6cb1bfddf645 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:17.721577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a5883-1c06-4154-a8af-6cb1bfddf645 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:17.728476 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:17.777749 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 252/501] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:29:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:29:17.778678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3314fcc-434d-4e3d-a1c6-ddf0df977c4b None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:17.825947 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a5883-1c06-4154-a8af-6cb1bfddf645 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:17.829184 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a5883-1c06-4154-a8af-6cb1bfddf645 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:17.897653 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:17.901546 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3314fcc-434d-4e3d-a1c6-ddf0df977c4b None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:17.948336 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c7ed8-4339-46ce-923c-045f7eb57fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:17.948957 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c7ed8-4339-46ce-923c-045f7eb57fc6 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:17.949235 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c7ed8-4339-46ce-923c-045f7eb57fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:17.949505 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c7ed8-4339-46ce-923c-045f7eb57fc6 None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:17.950176 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c7ed8-4339-46ce-923c-045f7eb57fc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:17.950480 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c7ed8-4339-46ce-923c-045f7eb57fc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:17.952564 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c7ed8-4339-46ce-923c-045f7eb57fc6 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:17.963161 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 250/502] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:29:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:29:17.964362 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a5883-1c06-4154-a8af-6cb1bfddf645 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:17.971526 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 253/503] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:17.972343 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c7ed8-4339-46ce-923c-045f7eb57fc6 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:18.004229 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:18.085801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a5883-1c06-4154-a8af-6cb1bfddf645 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:18.091765 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c7ed8-4339-46ce-923c-045f7eb57fc6 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:18.126801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae93d5-3f08-4e19-8a75-1061abc2cca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:18.127438 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae93d5-3f08-4e19-8a75-1061abc2cca2 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:18.127766 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae93d5-3f08-4e19-8a75-1061abc2cca2 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:18.128038 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae93d5-3f08-4e19-8a75-1061abc2cca2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:18.133096 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de24567-c1f6-41b2-a16c-421ef781a273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:18.133806 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de24567-c1f6-41b2-a16c-421ef781a273 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:18.134157 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de24567-c1f6-41b2-a16c-421ef781a273 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:18.134485 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de24567-c1f6-41b2-a16c-421ef781a273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:18.139465 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae93d5-3f08-4e19-8a75-1061abc2cca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:18.141090 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae93d5-3f08-4e19-8a75-1061abc2cca2 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:18.147454 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de24567-c1f6-41b2-a16c-421ef781a273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:18.149298 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de24567-c1f6-41b2-a16c-421ef781a273 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:18.157100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-cbae93d5-3f08-4e19-8a75-1061abc2cca2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:18.157100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:18.157100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:18.157100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:18.157100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:18.157100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:18.157100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:18.157100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:18.157100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:18.157100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:18.157100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:18.157100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:18.157100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:18.157100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:18.157100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:18.157100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:18.166552 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:18.166552 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:18.166552 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:18.166552 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:18.166552 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:18.166552 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:18.166552 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:18.166552 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:18.166552 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:18.166552 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:18.166552 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:18.166552 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:18.166552 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:18.166552 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:18.166552 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:18.166552 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:18.166552 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:18.167848 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:18.167848 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:18.167848 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:18.167848 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 251/504] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:18.167848 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae93d5-3f08-4e19-8a75-1061abc2cca2 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:18.168127 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-4de24567-c1f6-41b2-a16c-421ef781a273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:18.168127 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:18.168127 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:18.168127 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:18.168127 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:18.168127 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:18.168127 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:18.168127 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:18.168127 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:18.168127 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:18.168127 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:18.168127 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:18.168127 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:18.168127 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:18.168127 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:18.168127 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:18.168954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:18.168954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:18.168954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:18.168954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:18.168954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:18.168954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:18.168954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:18.168954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:18.168954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:18.168954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:18.168954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:18.168954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:18.168954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:18.168954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:18.168954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:18.168954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:18.168954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:18.169999 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:18.169999 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:18.169999 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:18.169999 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 254/505] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:18.169999 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de24567-c1f6-41b2-a16c-421ef781a273 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:18.178354 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:18.274292 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:18.283082 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae93d5-3f08-4e19-8a75-1061abc2cca2 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:18.299304 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de24567-c1f6-41b2-a16c-421ef781a273 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:18.330969 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699dfa41-1d4d-4646-8afb-8228c1ea8231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:18.331628 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699dfa41-1d4d-4646-8afb-8228c1ea8231 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:18.331910 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699dfa41-1d4d-4646-8afb-8228c1ea8231 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:18.332181 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699dfa41-1d4d-4646-8afb-8228c1ea8231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:18.337775 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2927550-8bdf-4c33-a88d-1c634f0fba80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:18.338717 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2927550-8bdf-4c33-a88d-1c634f0fba80 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:18.339006 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2927550-8bdf-4c33-a88d-1c634f0fba80 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:18.339283 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2927550-8bdf-4c33-a88d-1c634f0fba80 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:18.344354 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699dfa41-1d4d-4646-8afb-8228c1ea8231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:18.345873 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699dfa41-1d4d-4646-8afb-8228c1ea8231 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:18.349220 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2927550-8bdf-4c33-a88d-1c634f0fba80 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:18.351100 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2927550-8bdf-4c33-a88d-1c634f0fba80 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:18.362151 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-699dfa41-1d4d-4646-8afb-8228c1ea8231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:18.362151 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:18.362151 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:18.362151 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:18.362151 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:18.362151 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:18.362151 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:18.362151 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:18.362151 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:18.362151 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:18.362151 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:18.362151 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:18.362151 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:18.362151 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:18.362151 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:18.362151 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:18.363598 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:18.363598 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:18.363598 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:18.363598 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:18.363598 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:18.363598 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:18.363598 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:18.363598 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:18.363598 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:18.363598 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:18.363598 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:18.363598 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:18.363598 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:18.363598 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:18.363598 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:18.363598 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:18.363598 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:18.365259 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:18.365259 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:18.365259 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:18.365259 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 252/506] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:18.365259 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699dfa41-1d4d-4646-8afb-8228c1ea8231 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:18.365738 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-c2927550-8bdf-4c33-a88d-1c634f0fba80 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 20:29:18.365738 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:18.365738 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:18.365738 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:18.365738 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:18.365738 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:18.365738 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:18.365738 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:18.365738 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:18.365738 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:18.365738 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:18.365738 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:18.365738 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:29:18.365738 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:29:18.365738 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:29:18.365738 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:29:18.367377 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:18.367377 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:18.367377 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:29:18.367377 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:18.367377 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:29:18.367377 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:18.367377 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:18.367377 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:18.367377 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:18.367377 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:18.367377 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:18.367377 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:18.367377 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:18.367377 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:18.367377 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:18.367377 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:18.367377 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:18.367377 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:18.369068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:18.369068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:18.369068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:29:18.369068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:29:18.369068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:29:18.369068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:29:18.369068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:29:18.369068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:29:18.369068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 20:29:18.369068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:18.369068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 255/507] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 20:29:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:18.369068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2927550-8bdf-4c33-a88d-1c634f0fba80 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:18.430924 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:18.476310 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699dfa41-1d4d-4646-8afb-8228c1ea8231 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:18.497382 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2927550-8bdf-4c33-a88d-1c634f0fba80 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:18.516183 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a0c18-a469-461e-8f0e-eca424163869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:18.516793 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a0c18-a469-461e-8f0e-eca424163869 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:18.517134 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a0c18-a469-461e-8f0e-eca424163869 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:18.517334 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a0c18-a469-461e-8f0e-eca424163869 None admin] PATH_INFO: `/v3/domains` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:18.518102 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a0c18-a469-461e-8f0e-eca424163869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:18.518409 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a0c18-a469-461e-8f0e-eca424163869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:18.519890 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a0c18-a469-461e-8f0e-eca424163869 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:18.535082 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 253/508] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:18.536079 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a0c18-a469-461e-8f0e-eca424163869 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:18.538606 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bbe30-ebab-4b83-b5f9-09284bf8822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:18.539509 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bbe30-ebab-4b83-b5f9-09284bf8822d None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:18.540780 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bbe30-ebab-4b83-b5f9-09284bf8822d None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:18.541061 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bbe30-ebab-4b83-b5f9-09284bf8822d None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:18.541734 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bbe30-ebab-4b83-b5f9-09284bf8822d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:18.542043 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bbe30-ebab-4b83-b5f9-09284bf8822d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:18.543448 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bbe30-ebab-4b83-b5f9-09284bf8822d None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:18.554157 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:18.558020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 256/509] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:18.558875 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bbe30-ebab-4b83-b5f9-09284bf8822d None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:18.649822 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a0c18-a469-461e-8f0e-eca424163869 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:18.671240 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:18.673097 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bbe30-ebab-4b83-b5f9-09284bf8822d None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:18.693303 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e8d87-8266-47eb-84ae-fbc8a7c692cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:18.693929 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e8d87-8266-47eb-84ae-fbc8a7c692cc None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:18.694251 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e8d87-8266-47eb-84ae-fbc8a7c692cc None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:18.694524 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e8d87-8266-47eb-84ae-fbc8a7c692cc None admin] PATH_INFO: `/v3/domains` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:18.695310 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e8d87-8266-47eb-84ae-fbc8a7c692cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:18.695851 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e8d87-8266-47eb-84ae-fbc8a7c692cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:18.697437 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e8d87-8266-47eb-84ae-fbc8a7c692cc None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:18.711517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 254/510] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:18.712506 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e8d87-8266-47eb-84ae-fbc8a7c692cc None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:18.717043 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc509a41-582d-4c78-9cc6-1c3d85049843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:18.718605 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc509a41-582d-4c78-9cc6-1c3d85049843 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:18.718897 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc509a41-582d-4c78-9cc6-1c3d85049843 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:18.719176 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc509a41-582d-4c78-9cc6-1c3d85049843 None admin] PATH_INFO: `/v3/users` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:18.719983 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc509a41-582d-4c78-9cc6-1c3d85049843 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:18.720303 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc509a41-582d-4c78-9cc6-1c3d85049843 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:18.721792 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc509a41-582d-4c78-9cc6-1c3d85049843 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:18.742990 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 257/511] 10.222.0.15 () {56 vars in 1139 bytes} [Mon Aug 22 20:29:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:18.743908 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc509a41-582d-4c78-9cc6-1c3d85049843 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:18.808012 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:18.837028 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e8d87-8266-47eb-84ae-fbc8a7c692cc None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:18.855173 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc509a41-582d-4c78-9cc6-1c3d85049843 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:18.877638 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35efbe14-a5d5-44ef-8a67-b164af654c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:18.878698 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efbe14-a5d5-44ef-8a67-b164af654c99 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:18.879155 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efbe14-a5d5-44ef-8a67-b164af654c99 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:18.879621 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efbe14-a5d5-44ef-8a67-b164af654c99 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:18.892706 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efbe14-a5d5-44ef-8a67-b164af654c99 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:18.895205 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efbe14-a5d5-44ef-8a67-b164af654c99 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:18.898968 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd669a8-cba0-4896-8dfd-68755f2cf115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:18.899763 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd669a8-cba0-4896-8dfd-68755f2cf115 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:18.900095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd669a8-cba0-4896-8dfd-68755f2cf115 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:18.900434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd669a8-cba0-4896-8dfd-68755f2cf115 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:18.908942 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd669a8-cba0-4896-8dfd-68755f2cf115 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:18.909775 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-35efbe14-a5d5-44ef-8a67-b164af654c99 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 20:29:18.909775 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:18.909775 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:18.909775 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:18.909775 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:18.909775 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:18.909775 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:18.909775 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:18.909775 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:18.909775 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:18.909775 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:18.909775 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:18.909775 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:29:18.909775 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:29:18.909775 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:29:18.909775 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:29:18.911185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:18.911185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:18.911185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:29:18.911185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:18.911185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:29:18.911185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:18.911185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:18.911185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:18.911185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:18.911185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:18.911185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:18.911185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:18.911185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:18.911185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:18.911185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:18.911185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:18.911185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:18.911185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:18.912945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:18.912945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:18.912945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:29:18.912945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:29:18.912945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:29:18.912945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:29:18.912945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:29:18.912945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:29:18.912945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 20:29:18.912945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:18.913943 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd669a8-cba0-4896-8dfd-68755f2cf115 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:18.914067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 255/512] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:29:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:18.914067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35efbe14-a5d5-44ef-8a67-b164af654c99 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:18.930229 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-cdd669a8-cba0-4896-8dfd-68755f2cf115 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:18.930229 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:18.930229 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:18.930229 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:18.930229 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:18.930229 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:18.930229 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:18.930229 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:18.930229 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:18.930229 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:18.930229 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:18.930229 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:18.930229 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:29:18.930229 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:29:18.930229 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:29:18.932089 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:29:18.932089 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:18.932089 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:18.932089 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:18.932089 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:18.932089 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:18.932089 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:18.932089 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:18.932089 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:18.932089 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:18.932089 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:18.932089 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:18.932089 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:18.932089 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:18.932089 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:18.932089 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:18.932089 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:18.933899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:29:18.933899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:29:18.933899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:29:18.933899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:29:18.933899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:29:18.933899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:29:18.933899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:18.933899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:18.933899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 258/513] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:18.933899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd669a8-cba0-4896-8dfd-68755f2cf115 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:18.967033 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:19.037422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35efbe14-a5d5-44ef-8a67-b164af654c99 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:19.059412 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd669a8-cba0-4896-8dfd-68755f2cf115 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:19.074986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff93c4-f22f-4613-9367-b2f721309c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:19.075924 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff93c4-f22f-4613-9367-b2f721309c10 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:19.076266 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff93c4-f22f-4613-9367-b2f721309c10 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:19.076654 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff93c4-f22f-4613-9367-b2f721309c10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:19.079722 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:19.085786 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff93c4-f22f-4613-9367-b2f721309c10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:19.087654 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff93c4-f22f-4613-9367-b2f721309c10 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:19.103230 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf16efc-b608-488f-b328-30b3f72a334e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:19.104185 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf16efc-b608-488f-b328-30b3f72a334e None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:19.104800 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf16efc-b608-488f-b328-30b3f72a334e None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:19.105245 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf16efc-b608-488f-b328-30b3f72a334e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:19.109127 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-f9ff93c4-f22f-4613-9367-b2f721309c10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:19.109127 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:19.109127 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:19.109127 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:19.109127 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:19.109127 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:19.109127 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:19.109127 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:19.109127 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:19.109127 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:19.109127 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:19.109127 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:19.109127 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:29:19.109127 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:29:19.109127 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:29:19.110490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:29:19.110490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:19.110490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:19.110490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:19.110490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:19.110490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:19.110490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:19.110490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:19.110490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:19.110490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:19.110490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:19.110490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:19.110490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:19.110490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:19.110490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:19.110490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:19.110490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:19.111402 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:29:19.111402 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:29:19.111402 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:29:19.111402 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:29:19.111402 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:29:19.111402 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:29:19.111402 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:19.111402 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:19.111402 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 256/514] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:19.112318 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff93c4-f22f-4613-9367-b2f721309c10 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:19.190438 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf16efc-b608-488f-b328-30b3f72a334e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:19.192165 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf16efc-b608-488f-b328-30b3f72a334e None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:19.231984 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:19.236274 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff93c4-f22f-4613-9367-b2f721309c10 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:19.279430 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8abcf-b909-4663-ad26-702db85c30c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:19.280108 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8abcf-b909-4663-ad26-702db85c30c7 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:19.280389 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8abcf-b909-4663-ad26-702db85c30c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:19.280659 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8abcf-b909-4663-ad26-702db85c30c7 None admin] PATH_INFO: `/v3/users` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:19.281422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8abcf-b909-4663-ad26-702db85c30c7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:19.281718 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8abcf-b909-4663-ad26-702db85c30c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:19.283220 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8abcf-b909-4663-ad26-702db85c30c7 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:19.316793 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 259/515] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:29:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:29:19.316793 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf16efc-b608-488f-b328-30b3f72a334e None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:19.337860 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 257/516] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Aug 22 20:29:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:19.337860 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8abcf-b909-4663-ad26-702db85c30c7 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:19.344866 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:19.440507 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf16efc-b608-488f-b328-30b3f72a334e None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:19.461295 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8abcf-b909-4663-ad26-702db85c30c7 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:19.483631 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146994f-8b82-4be0-b749-9f8acdddb7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:19.484287 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146994f-8b82-4be0-b749-9f8acdddb7ae None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:19.484636 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146994f-8b82-4be0-b749-9f8acdddb7ae None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:19.484907 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146994f-8b82-4be0-b749-9f8acdddb7ae None admin] PATH_INFO: `/v3/projects` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:19.485677 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146994f-8b82-4be0-b749-9f8acdddb7ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:19.486143 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146994f-8b82-4be0-b749-9f8acdddb7ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:19.488100 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146994f-8b82-4be0-b749-9f8acdddb7ae None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:19.502374 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32924b0f-34a1-48b0-9d78-b1ae23146bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:19.503002 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32924b0f-34a1-48b0-9d78-b1ae23146bea None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:19.503281 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32924b0f-34a1-48b0-9d78-b1ae23146bea None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:19.503579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32924b0f-34a1-48b0-9d78-b1ae23146bea None admin] PATH_INFO: `/v3/projects` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:19.504319 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32924b0f-34a1-48b0-9d78-b1ae23146bea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:19.504626 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32924b0f-34a1-48b0-9d78-b1ae23146bea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:19.506107 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32924b0f-34a1-48b0-9d78-b1ae23146bea None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:19.512679 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 260/517] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 20:29:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:19.512679 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146994f-8b82-4be0-b749-9f8acdddb7ae None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:19.532436 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 258/518] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 20:29:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:19.533318 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32924b0f-34a1-48b0-9d78-b1ae23146bea None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:19.557697 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:19.592165 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:19.613570 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146994f-8b82-4be0-b749-9f8acdddb7ae None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:19.640290 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32924b0f-34a1-48b0-9d78-b1ae23146bea None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:19.648754 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec07f76-8498-4abb-8304-da050aff4a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:19.649405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec07f76-8498-4abb-8304-da050aff4a6e None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:19.649689 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec07f76-8498-4abb-8304-da050aff4a6e None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:19.649967 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec07f76-8498-4abb-8304-da050aff4a6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:19.660503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec07f76-8498-4abb-8304-da050aff4a6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:19.662009 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec07f76-8498-4abb-8304-da050aff4a6e None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:19.674752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9545e6-b1fd-4e31-9f8e-4e75df37b395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:19.675358 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9545e6-b1fd-4e31-9f8e-4e75df37b395 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:19.675669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9545e6-b1fd-4e31-9f8e-4e75df37b395 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:19.675943 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9545e6-b1fd-4e31-9f8e-4e75df37b395 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:19.678107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-6ec07f76-8498-4abb-8304-da050aff4a6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:19.678107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:19.678107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:19.678107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:19.678107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:19.678107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:19.678107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:19.678107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:19.678107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:19.678107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:19.678107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:19.678107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:19.678107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:19.678107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:19.678107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:19.678107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:19.679095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:19.679095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:19.679095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:19.679095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:19.679095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:19.679095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:19.679095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:19.679095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:19.679095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:19.679095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:19.679095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:19.679095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:19.679095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:19.679095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:19.679095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:19.679095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:19.679095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:19.679995 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:19.679995 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:19.679995 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:19.679995 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 261/519] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:19.680210 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec07f76-8498-4abb-8304-da050aff4a6e None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:19.751497 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9545e6-b1fd-4e31-9f8e-4e75df37b395 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:19.753033 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9545e6-b1fd-4e31-9f8e-4e75df37b395 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:19.770254 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:19.785788 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec07f76-8498-4abb-8304-da050aff4a6e None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:19.816135 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:19.822463 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f9098-f885-4140-9dd9-f5f68e99ee9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:19.823074 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f9098-f885-4140-9dd9-f5f68e99ee9b None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:19.823354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f9098-f885-4140-9dd9-f5f68e99ee9b None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:19.823670 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f9098-f885-4140-9dd9-f5f68e99ee9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:19.824516 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f9098-f885-4140-9dd9-f5f68e99ee9b None admin] RBAC: Adding query filter params (role.id=b92ee6686fe5412f9b7fdf27fb4c21d3, scope.project.id=7bda5c44ace24608b8ca69e9059d73ef, user.id=d0b7833b75334bceb549f7184041aacc) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:19.824828 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f9098-f885-4140-9dd9-f5f68e99ee9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:19.826283 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f9098-f885-4140-9dd9-f5f68e99ee9b None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:19.832113 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 262/520] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:29:19 2022] GET /identity/v3/role_assignments?user.id=d0b7833b75334bceb549f7184041aacc&scope.project.id=7bda5c44ace24608b8ca69e9059d73ef&role.id=b92ee6686fe5412f9b7fdf27fb4c21d3 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:19.832747 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f9098-f885-4140-9dd9-f5f68e99ee9b None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:19.887143 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 259/521] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:29:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:29:19.887143 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9545e6-b1fd-4e31-9f8e-4e75df37b395 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:19.961677 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f9098-f885-4140-9dd9-f5f68e99ee9b None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:20.002015 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6422bd-c4ab-4d5d-985c-080d23f5e83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:20.002639 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6422bd-c4ab-4d5d-985c-080d23f5e83f None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:20.002918 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6422bd-c4ab-4d5d-985c-080d23f5e83f None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:20.003192 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6422bd-c4ab-4d5d-985c-080d23f5e83f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:20.003524 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9545e6-b1fd-4e31-9f8e-4e75df37b395 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:20.003969 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6422bd-c4ab-4d5d-985c-080d23f5e83f None admin] RBAC: Adding query filter params (role.id=b92ee6686fe5412f9b7fdf27fb4c21d3, scope.project.id=7bda5c44ace24608b8ca69e9059d73ef, user.id=c18d1768fb7a4bac93b28d095b74caf6) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:20.004281 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6422bd-c4ab-4d5d-985c-080d23f5e83f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:20.005760 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6422bd-c4ab-4d5d-985c-080d23f5e83f None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:20.011730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 263/522] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:29:19 2022] GET /identity/v3/role_assignments?user.id=c18d1768fb7a4bac93b28d095b74caf6&scope.project.id=7bda5c44ace24608b8ca69e9059d73ef&role.id=b92ee6686fe5412f9b7fdf27fb4c21d3 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:20.012984 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6422bd-c4ab-4d5d-985c-080d23f5e83f None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:20.029496 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:20.060467 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbf19c-bb51-4559-8059-8423a67140b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:20.061304 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbf19c-bb51-4559-8059-8423a67140b4 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:20.061677 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbf19c-bb51-4559-8059-8423a67140b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:20.062129 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbf19c-bb51-4559-8059-8423a67140b4 None admin] PATH_INFO: `/v3/domains` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:20.062898 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbf19c-bb51-4559-8059-8423a67140b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:20.063312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbf19c-bb51-4559-8059-8423a67140b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:20.075803 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbf19c-bb51-4559-8059-8423a67140b4 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:20.087603 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:20.093588 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 260/523] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:20.099447 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbf19c-bb51-4559-8059-8423a67140b4 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:20.151167 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6422bd-c4ab-4d5d-985c-080d23f5e83f None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:20.209922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052aca3-925f-441a-b970-63536f2c45b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:20.211171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052aca3-925f-441a-b970-63536f2c45b1 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:20.211449 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052aca3-925f-441a-b970-63536f2c45b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:20.211881 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052aca3-925f-441a-b970-63536f2c45b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:20.227144 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052aca3-925f-441a-b970-63536f2c45b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:20.228992 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052aca3-925f-441a-b970-63536f2c45b1 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:20.237318 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbf19c-bb51-4559-8059-8423a67140b4 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:20.248836 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-6052aca3-925f-441a-b970-63536f2c45b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:20.248836 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:20.248836 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:20.248836 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:20.248836 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:20.248836 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:20.248836 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:20.248836 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:20.248836 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:20.248836 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:20.248836 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:20.248836 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:20.248836 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:20.248836 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:20.248836 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:20.248836 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:20.250109 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:20.250109 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:20.250109 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:20.250109 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:20.250109 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:20.250109 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:20.250109 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:20.250109 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:20.250109 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:20.250109 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:20.250109 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:20.250109 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:20.250109 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:20.250109 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:20.250109 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:20.250109 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:20.250109 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:20.251941 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:20.251941 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:20.251941 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:20.255639 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 264/524] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:20.257668 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052aca3-925f-441a-b970-63536f2c45b1 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:20.293376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8fd26-cf95-4082-974d-77b5ebdfaf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:20.294292 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8fd26-cf95-4082-974d-77b5ebdfaf21 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:20.294568 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8fd26-cf95-4082-974d-77b5ebdfaf21 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:20.295302 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8fd26-cf95-4082-974d-77b5ebdfaf21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:20.305301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8fd26-cf95-4082-974d-77b5ebdfaf21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:20.307789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8fd26-cf95-4082-974d-77b5ebdfaf21 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:20.323741 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-52e8fd26-cf95-4082-974d-77b5ebdfaf21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:20.323741 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:20.323741 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:20.323741 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:20.323741 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:20.323741 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:20.323741 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:20.323741 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:20.323741 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:20.323741 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:20.323741 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:20.323741 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:20.323741 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:29:20.323741 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:29:20.323741 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:29:20.324859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:29:20.324859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:20.324859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:20.324859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:20.324859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:20.324859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:20.324859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:20.324859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:20.324859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:20.324859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:20.324859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:20.324859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:20.324859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:20.324859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:20.324859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:20.324859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:20.324859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:20.325911 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:29:20.325911 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:29:20.325911 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:29:20.325911 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:29:20.325911 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:29:20.325911 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:29:20.325911 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:20.325911 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:20.330412 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 261/525] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:29:20.332490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8fd26-cf95-4082-974d-77b5ebdfaf21 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:20.372527 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:20.384823 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052aca3-925f-441a-b970-63536f2c45b1 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:20.397010 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:20.423982 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b394a-94b0-43b7-9b99-07496df6348b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:20.424680 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b394a-94b0-43b7-9b99-07496df6348b None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:20.425071 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b394a-94b0-43b7-9b99-07496df6348b None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:20.425355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b394a-94b0-43b7-9b99-07496df6348b None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:20.426012 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b394a-94b0-43b7-9b99-07496df6348b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:20.426320 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b394a-94b0-43b7-9b99-07496df6348b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:20.427916 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b394a-94b0-43b7-9b99-07496df6348b None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:20.445804 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 265/526] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:20.454456 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8fd26-cf95-4082-974d-77b5ebdfaf21 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:20.457303 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b394a-94b0-43b7-9b99-07496df6348b None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:20.497789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e10b3-d6ba-4c6d-bbe9-b538ae80ed3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:20.498403 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e10b3-d6ba-4c6d-bbe9-b538ae80ed3d None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:20.498749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e10b3-d6ba-4c6d-bbe9-b538ae80ed3d None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:20.499088 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e10b3-d6ba-4c6d-bbe9-b538ae80ed3d None admin] PATH_INFO: `/v3/projects` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:20.499832 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e10b3-d6ba-4c6d-bbe9-b538ae80ed3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:20.500134 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e10b3-d6ba-4c6d-bbe9-b538ae80ed3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:20.501644 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e10b3-d6ba-4c6d-bbe9-b538ae80ed3d None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:20.519676 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 262/527] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 20:29:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:20.525565 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e10b3-d6ba-4c6d-bbe9-b538ae80ed3d None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:20.623414 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b394a-94b0-43b7-9b99-07496df6348b None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:20.655946 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:20.664829 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e10b3-d6ba-4c6d-bbe9-b538ae80ed3d None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:20.666034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8c14a-3097-45fc-970d-4f2da526d628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:20.666801 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8c14a-3097-45fc-970d-4f2da526d628 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:20.667182 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8c14a-3097-45fc-970d-4f2da526d628 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:20.667570 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8c14a-3097-45fc-970d-4f2da526d628 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:20.681170 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8c14a-3097-45fc-970d-4f2da526d628 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:20.681170 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8c14a-3097-45fc-970d-4f2da526d628 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:20.690060 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-7ee8c14a-3097-45fc-970d-4f2da526d628 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:20.690060 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:20.690060 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:20.690060 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:20.690060 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:20.690060 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:20.690060 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:20.690060 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:20.690060 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:20.690060 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:20.690060 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:20.690060 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:20.690060 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:29:20.690060 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:29:20.690060 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:29:20.690996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:29:20.690996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:20.690996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:20.690996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:20.690996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:20.690996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:20.690996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:20.690996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:20.690996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:20.690996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:20.690996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:20.690996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:20.690996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:20.690996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:20.690996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:20.690996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:20.690996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:20.691944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:29:20.691944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:29:20.691944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:29:20.691944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:29:20.691944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:29:20.691944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:29:20.691944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:20.691944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:20.692360 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 266/528] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:20.698424 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8c14a-3097-45fc-970d-4f2da526d628 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:20.713330 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25571b2-6897-4f09-a17d-020d6d547df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:20.714361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25571b2-6897-4f09-a17d-020d6d547df1 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:20.714926 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25571b2-6897-4f09-a17d-020d6d547df1 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:20.715358 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25571b2-6897-4f09-a17d-020d6d547df1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:20.724156 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25571b2-6897-4f09-a17d-020d6d547df1 None admin] RBAC: Adding query filter params (role.id=b92ee6686fe5412f9b7fdf27fb4c21d3, scope.project.id=7bda5c44ace24608b8ca69e9059d73ef, user.id=340a791917d14686bb14e13544c1ce9b) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:20.724156 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25571b2-6897-4f09-a17d-020d6d547df1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:20.724156 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25571b2-6897-4f09-a17d-020d6d547df1 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:20.726155 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 263/529] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:29:20 2022] GET /identity/v3/role_assignments?user.id=340a791917d14686bb14e13544c1ce9b&scope.project.id=7bda5c44ace24608b8ca69e9059d73ef&role.id=b92ee6686fe5412f9b7fdf27fb4c21d3 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:20.752918 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:20.846149 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8c14a-3097-45fc-970d-4f2da526d628 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:20.888526 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd8f91-fbc7-4c01-8ed9-27be9c34cad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:20.889160 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd8f91-fbc7-4c01-8ed9-27be9c34cad0 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:20.890001 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd8f91-fbc7-4c01-8ed9-27be9c34cad0 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:20.890274 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd8f91-fbc7-4c01-8ed9-27be9c34cad0 None admin] PATH_INFO: `/v3/projects` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:20.890995 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd8f91-fbc7-4c01-8ed9-27be9c34cad0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:20.891305 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd8f91-fbc7-4c01-8ed9-27be9c34cad0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:20.892863 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd8f91-fbc7-4c01-8ed9-27be9c34cad0 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:20.906990 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 267/530] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 20:29:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:20.919012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25571b2-6897-4f09-a17d-020d6d547df1 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:21.088091 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25571b2-6897-4f09-a17d-020d6d547df1 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:21.128433 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181baa9-bf48-4157-9545-5aa24344dc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:21.129438 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181baa9-bf48-4157-9545-5aa24344dc95 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:21.129920 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181baa9-bf48-4157-9545-5aa24344dc95 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:21.130399 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181baa9-bf48-4157-9545-5aa24344dc95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:21.131348 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181baa9-bf48-4157-9545-5aa24344dc95 None admin] RBAC: Adding query filter params (role.id=b92ee6686fe5412f9b7fdf27fb4c21d3, scope.project.id=7bda5c44ace24608b8ca69e9059d73ef, user.id=dcac07ea52e44b7cb7df360dbec74254) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:21.131881 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181baa9-bf48-4157-9545-5aa24344dc95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:21.133570 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181baa9-bf48-4157-9545-5aa24344dc95 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:21.140503 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 264/531] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:29:20 2022] GET /identity/v3/role_assignments?user.id=dcac07ea52e44b7cb7df360dbec74254&scope.project.id=7bda5c44ace24608b8ca69e9059d73ef&role.id=b92ee6686fe5412f9b7fdf27fb4c21d3 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:22.273689 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53329c8-6b7e-4cfd-81f6-e02a3b6e8e32 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:22.274247 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53329c8-6b7e-4cfd-81f6-e02a3b6e8e32 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:22.274247 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53329c8-6b7e-4cfd-81f6-e02a3b6e8e32 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:22.275756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 268/532] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:22.282493 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850c352-f3b2-499e-8cfa-bd26122a007e None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:22.283515 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850c352-f3b2-499e-8cfa-bd26122a007e None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:22.284069 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850c352-f3b2-499e-8cfa-bd26122a007e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:22.303376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-7850c352-f3b2-499e-8cfa-bd26122a007e None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:22.305002 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-7850c352-f3b2-499e-8cfa-bd26122a007e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:22.325253 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:22.382507 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 265/533] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:29:22.661999 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fbd7e-fd32-42c5-b062-d66dca0ea090 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:22.662323 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fbd7e-fd32-42c5-b062-d66dca0ea090 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:22.662678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fbd7e-fd32-42c5-b062-d66dca0ea090 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:22.664222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 269/534] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:29:22.669799 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65939d56-f774-4790-aa98-778414ced697 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:22.670176 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65939d56-f774-4790-aa98-778414ced697 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:22.670947 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65939d56-f774-4790-aa98-778414ced697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:22.690898 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-65939d56-f774-4790-aa98-778414ced697 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:22.692157 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-65939d56-f774-4790-aa98-778414ced697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:22.768456 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 266/535] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:29:22.847839 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fbd7e-fd32-42c5-b062-d66dca0ea090 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:22.953320 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:22.964597 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fbd7e-fd32-42c5-b062-d66dca0ea090 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:23.007195 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f310602-5649-4808-abb4-0b75f735e4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:23.007880 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f310602-5649-4808-abb4-0b75f735e4c3 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:23.008163 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f310602-5649-4808-abb4-0b75f735e4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:23.008511 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f310602-5649-4808-abb4-0b75f735e4c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:23.021365 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f310602-5649-4808-abb4-0b75f735e4c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:23.026513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-6f310602-5649-4808-abb4-0b75f735e4c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:23.026513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:23.026513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:23.026513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:23.026513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:23.026513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:23.026513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:23.026513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:23.026513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:23.026513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:23.026513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:23.026513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:23.026513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:23.026513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:23.026513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:23.026513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:23.027496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:23.027496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:23.027496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:23.027496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:23.027496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:23.027496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:23.027496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:23.027496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:23.027496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:23.027496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:23.027496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:23.027496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:23.027496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:23.027496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:23.027496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:23.027496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:23.028367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:23.028367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:23.028367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:23.028367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:23.028367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:23.028367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:23.028367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:23.028367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:23.028367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:23.028367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:23.028367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:23.028367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:23.028367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 270/536] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 20:29:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:23.034233 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65939d56-f774-4790-aa98-778414ced697 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:23.126579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:23.128540 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f310602-5649-4808-abb4-0b75f735e4c3 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:23.145173 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65939d56-f774-4790-aa98-778414ced697 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:23.183051 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d65d75-4578-481d-8ef8-574613de21f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:23.183708 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d65d75-4578-481d-8ef8-574613de21f9 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:23.183989 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d65d75-4578-481d-8ef8-574613de21f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:23.184261 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d65d75-4578-481d-8ef8-574613de21f9 None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:23.184922 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d65d75-4578-481d-8ef8-574613de21f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:23.185226 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d65d75-4578-481d-8ef8-574613de21f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:23.187429 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d65d75-4578-481d-8ef8-574613de21f9 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:23.196858 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 267/537] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 20:29:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:23.198138 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5020eea-7d59-4406-bd86-8111445f0118 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:23.198424 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5020eea-7d59-4406-bd86-8111445f0118 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:23.198726 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5020eea-7d59-4406-bd86-8111445f0118 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:23.200184 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 268/538] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:23.208595 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5020eea-7d59-4406-bd86-8111445f0118 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:23.264291 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f310602-5649-4808-abb4-0b75f735e4c3 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:23.303429 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7897ced-03ff-4f5b-b743-21182807e52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:23.304809 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7897ced-03ff-4f5b-b743-21182807e52d None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:23.305293 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7897ced-03ff-4f5b-b743-21182807e52d None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:23.305796 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7897ced-03ff-4f5b-b743-21182807e52d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:23.318402 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7897ced-03ff-4f5b-b743-21182807e52d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:23.324135 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-f7897ced-03ff-4f5b-b743-21182807e52d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:23.324135 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:23.324135 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:23.324135 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:23.324135 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:23.324135 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:23.324135 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:23.324135 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:23.324135 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:23.324135 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:23.324135 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:23.324135 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:23.324135 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:23.324135 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:23.324135 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:23.324135 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:23.325083 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:23.325083 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:23.325083 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:23.325083 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:23.325083 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:23.325083 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:23.325083 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:23.325083 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:23.325083 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:23.325083 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:23.325083 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:23.325083 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:23.325083 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:23.325083 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:23.325083 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:23.325083 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:23.325869 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:23.325869 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:23.325869 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:23.325869 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:23.325869 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:23.325869 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:23.325869 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:23.325869 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:23.325869 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:23.325869 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:23.325869 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:23.325869 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:23.325869 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 271/539] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 20:29:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:23.331378 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da8da1-da25-4724-a317-d20ebbd2603f None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:23.331798 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da8da1-da25-4724-a317-d20ebbd2603f None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:23.332141 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da8da1-da25-4724-a317-d20ebbd2603f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:23.336199 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5020eea-7d59-4406-bd86-8111445f0118 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:23.350886 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-96da8da1-da25-4724-a317-d20ebbd2603f None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:23.352200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-96da8da1-da25-4724-a317-d20ebbd2603f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:23.355460 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:23.372195 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e454879-da3d-4c04-8372-084b1cbf26a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:23.372965 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e454879-da3d-4c04-8372-084b1cbf26a8 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:23.375697 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e454879-da3d-4c04-8372-084b1cbf26a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:23.375697 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e454879-da3d-4c04-8372-084b1cbf26a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:23.389004 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e454879-da3d-4c04-8372-084b1cbf26a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:23.390535 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e454879-da3d-4c04-8372-084b1cbf26a8 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:23.397773 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:23.407336 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-4e454879-da3d-4c04-8372-084b1cbf26a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:23.407336 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:23.407336 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:23.407336 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:23.407336 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:23.407336 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:23.407336 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:23.407336 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:23.407336 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:23.407336 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:23.407336 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:23.407336 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:23.407336 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:23.407336 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:23.407336 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:23.407336 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:23.408475 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:23.408475 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:23.408475 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:23.408475 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:23.408475 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:23.408475 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:23.408475 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:23.408475 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:23.408475 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:23.408475 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:23.408475 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:23.408475 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:23.408475 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:23.408475 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:23.408475 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:23.408475 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:23.408475 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:23.409328 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:23.409328 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:23.409328 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:23.409328 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 269/540] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:23.409549 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e454879-da3d-4c04-8372-084b1cbf26a8 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:23.435104 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 272/541] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:29:23.437232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba203135-ca6f-4e90-8398-0d9d45c095de None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:23.437522 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba203135-ca6f-4e90-8398-0d9d45c095de None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:23.437797 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba203135-ca6f-4e90-8398-0d9d45c095de None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:23.439599 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 273/542] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:23.439765 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba203135-ca6f-4e90-8398-0d9d45c095de None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:23.526801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e454879-da3d-4c04-8372-084b1cbf26a8 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:23.549915 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba203135-ca6f-4e90-8398-0d9d45c095de None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:23.572716 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62fe4b-ea81-44ca-a669-c7c48e502d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:23.573321 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62fe4b-ea81-44ca-a669-c7c48e502d88 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:23.573605 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62fe4b-ea81-44ca-a669-c7c48e502d88 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:23.573879 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62fe4b-ea81-44ca-a669-c7c48e502d88 None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:23.574537 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62fe4b-ea81-44ca-a669-c7c48e502d88 None admin] RBAC: Adding query filter params (name=service) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:23.574839 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62fe4b-ea81-44ca-a669-c7c48e502d88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:23.576516 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62fe4b-ea81-44ca-a669-c7c48e502d88 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:23.590282 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 270/543] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 20:29:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:23.590459 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53e40c-c317-4ed2-9d4a-f653bbb01fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:23.590459 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53e40c-c317-4ed2-9d4a-f653bbb01fa0 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:23.590660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c3a7f-778b-40dc-bd1b-7432a7a16dd5 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:23.590743 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53e40c-c317-4ed2-9d4a-f653bbb01fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:23.590835 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c3a7f-778b-40dc-bd1b-7432a7a16dd5 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:23.590924 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53e40c-c317-4ed2-9d4a-f653bbb01fa0 None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:23.591003 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c3a7f-778b-40dc-bd1b-7432a7a16dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:23.591092 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53e40c-c317-4ed2-9d4a-f653bbb01fa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:23.591092 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53e40c-c317-4ed2-9d4a-f653bbb01fa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:23.591268 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53e40c-c317-4ed2-9d4a-f653bbb01fa0 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:23.600871 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:23.604433 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 274/544] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:23.605338 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53e40c-c317-4ed2-9d4a-f653bbb01fa0 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:23.613854 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-671c3a7f-778b-40dc-bd1b-7432a7a16dd5 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:23.615056 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-671c3a7f-778b-40dc-bd1b-7432a7a16dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:23.672749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:23.691910 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 271/545] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:29:23.693334 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c3a7f-778b-40dc-bd1b-7432a7a16dd5 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:23.718494 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53e40c-c317-4ed2-9d4a-f653bbb01fa0 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:23.755644 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7183775-f2b4-4b3e-a271-6ee7448ab06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:23.756370 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7183775-f2b4-4b3e-a271-6ee7448ab06b None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:23.756655 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7183775-f2b4-4b3e-a271-6ee7448ab06b None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:23.756930 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7183775-f2b4-4b3e-a271-6ee7448ab06b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:23.768873 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7183775-f2b4-4b3e-a271-6ee7448ab06b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:23.770361 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7183775-f2b4-4b3e-a271-6ee7448ab06b None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:23.785763 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-c7183775-f2b4-4b3e-a271-6ee7448ab06b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:23.785763 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:23.785763 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:23.785763 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:23.785763 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:23.785763 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:23.785763 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:23.785763 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:23.785763 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:23.785763 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:23.785763 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:23.785763 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:23.785763 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:23.785763 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:23.785763 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:23.785763 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:23.786715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:23.786715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:23.786715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:23.786715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:23.786715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:23.786715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:23.786715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:23.786715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:23.786715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:23.786715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:23.786715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:23.786715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:23.786715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:23.786715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:23.786715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:23.786715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:23.786715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:23.787584 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:23.787584 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:23.787584 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:23.787584 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 275/546] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:23.787812 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7183775-f2b4-4b3e-a271-6ee7448ab06b None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:23.828933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c3a7f-778b-40dc-bd1b-7432a7a16dd5 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:23.848300 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:23.867995 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f4d70-93ad-4ee4-a859-7042c4d78d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:23.868621 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f4d70-93ad-4ee4-a859-7042c4d78d0f None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:23.868895 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f4d70-93ad-4ee4-a859-7042c4d78d0f None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:23.869165 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f4d70-93ad-4ee4-a859-7042c4d78d0f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:23.876992 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f4d70-93ad-4ee4-a859-7042c4d78d0f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:23.878607 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f4d70-93ad-4ee4-a859-7042c4d78d0f None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:23.891110 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-999f4d70-93ad-4ee4-a859-7042c4d78d0f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:29:23.891110 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:23.891110 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:23.891110 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:23.891110 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:23.891110 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:23.891110 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:23.891110 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:23.891110 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:23.891110 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:23.891110 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:23.891110 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:23.891110 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:29:23.891110 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:29:23.891110 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:29:23.891110 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:29:23.892101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:23.892101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:23.892101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:29:23.892101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:23.892101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:29:23.892101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:23.892101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:23.892101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:23.892101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:23.892101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:23.892101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:23.892101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:23.892101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:23.892101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:23.892101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:23.892101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:23.892101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:23.892101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:23.893046 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:23.893046 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:23.893046 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:29:23.893046 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:29:23.893046 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:29:23.893046 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:29:23.893046 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:29:23.893046 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:29:23.893046 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:29:23.893046 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:23.893046 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 272/547] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:29:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:23.893046 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f4d70-93ad-4ee4-a859-7042c4d78d0f None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:23.904084 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7183775-f2b4-4b3e-a271-6ee7448ab06b None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:23.945267 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debe6db-330b-4c29-810b-e26109cb11dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:23.946266 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debe6db-330b-4c29-810b-e26109cb11dc None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:23.946545 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debe6db-330b-4c29-810b-e26109cb11dc None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:23.946874 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debe6db-330b-4c29-810b-e26109cb11dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:23.954550 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:23.959409 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debe6db-330b-4c29-810b-e26109cb11dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:23.964715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-6debe6db-330b-4c29-810b-e26109cb11dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:23.964715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:23.964715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:23.964715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:23.964715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:23.964715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:23.964715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:23.964715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:23.964715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:23.964715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:23.964715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:23.964715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:23.964715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:23.964715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:23.964715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:23.964715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:23.965617 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:23.965617 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:23.965617 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:23.965617 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:23.965617 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:23.965617 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:23.965617 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:23.965617 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:23.965617 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:23.965617 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:23.965617 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:23.965617 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:23.965617 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:23.965617 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:23.965617 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:23.965617 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:23.966399 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:23.966399 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:23.966399 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:23.966399 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:23.966399 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:23.966399 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:23.966399 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:23.966399 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:23.966399 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:23.966399 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:23.966399 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:23.966399 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:23.966399 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 276/548] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 20:29:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:23.967135 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debe6db-330b-4c29-810b-e26109cb11dc None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:24.016092 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f4d70-93ad-4ee4-a859-7042c4d78d0f None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:24.051018 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18b370-a88e-4a9b-b899-2d29c45d5c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:24.051663 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18b370-a88e-4a9b-b899-2d29c45d5c87 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:24.051947 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18b370-a88e-4a9b-b899-2d29c45d5c87 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:24.052222 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18b370-a88e-4a9b-b899-2d29c45d5c87 None admin] PATH_INFO: `/v3/domains` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:24.052961 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18b370-a88e-4a9b-b899-2d29c45d5c87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:24.053519 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18b370-a88e-4a9b-b899-2d29c45d5c87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:24.054706 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18b370-a88e-4a9b-b899-2d29c45d5c87 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:24.066950 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 273/549] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:24.067810 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18b370-a88e-4a9b-b899-2d29c45d5c87 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:24.079870 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debe6db-330b-4c29-810b-e26109cb11dc None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:24.093943 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:24.115365 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763e5b2-6c3d-4f22-bdc7-3fb2d027a81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:24.119242 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763e5b2-6c3d-4f22-bdc7-3fb2d027a81d None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:24.119242 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763e5b2-6c3d-4f22-bdc7-3fb2d027a81d None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:24.119242 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763e5b2-6c3d-4f22-bdc7-3fb2d027a81d None admin] PATH_INFO: `/v3/users` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:24.119242 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763e5b2-6c3d-4f22-bdc7-3fb2d027a81d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:24.119242 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763e5b2-6c3d-4f22-bdc7-3fb2d027a81d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:24.119242 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763e5b2-6c3d-4f22-bdc7-3fb2d027a81d None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:24.137166 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 277/550] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Aug 22 20:29:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:24.138108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763e5b2-6c3d-4f22-bdc7-3fb2d027a81d None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:24.175097 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18b370-a88e-4a9b-b899-2d29c45d5c87 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:24.186543 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:24.211890 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5cb13-96ee-46c4-af86-68892f940b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:24.212412 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5cb13-96ee-46c4-af86-68892f940b08 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:24.212691 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5cb13-96ee-46c4-af86-68892f940b08 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:24.212962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5cb13-96ee-46c4-af86-68892f940b08 None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:24.213631 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5cb13-96ee-46c4-af86-68892f940b08 None admin] RBAC: Adding query filter params (name=service) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:24.213931 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5cb13-96ee-46c4-af86-68892f940b08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:24.215316 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5cb13-96ee-46c4-af86-68892f940b08 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:24.224953 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 274/551] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 20:29:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:24.225796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5cb13-96ee-46c4-af86-68892f940b08 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:24.248433 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763e5b2-6c3d-4f22-bdc7-3fb2d027a81d None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:24.283077 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd2623-9822-4ce3-8404-f5681aed2f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:24.283741 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd2623-9822-4ce3-8404-f5681aed2f43 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:24.284022 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd2623-9822-4ce3-8404-f5681aed2f43 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:24.284294 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd2623-9822-4ce3-8404-f5681aed2f43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:24.296044 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd2623-9822-4ce3-8404-f5681aed2f43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:24.300979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-55cd2623-9822-4ce3-8404-f5681aed2f43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:24.300979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:24.300979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:24.300979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:24.300979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:24.300979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:24.300979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:24.300979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:24.300979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:24.300979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:24.300979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:24.300979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:24.300979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:24.300979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:24.300979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:24.300979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:24.301918 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:24.301918 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:24.301918 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:24.301918 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:24.301918 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:24.301918 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:24.301918 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:24.301918 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:24.301918 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:24.301918 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:24.301918 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:24.301918 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:24.301918 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:24.301918 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:24.301918 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:24.301918 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:24.302780 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:24.302780 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:24.302780 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:24.302780 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:24.302780 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:24.302780 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:24.302780 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:24.302780 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:24.302780 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:24.302780 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:24.302780 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:24.302780 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:24.302780 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 278/552] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 20:29:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:24.304632 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd2623-9822-4ce3-8404-f5681aed2f43 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:24.326436 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5cb13-96ee-46c4-af86-68892f940b08 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:24.335533 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:24.361307 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1bab1-262d-4985-b2e1-4c51ae925da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:24.361978 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1bab1-262d-4985-b2e1-4c51ae925da9 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:24.362261 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1bab1-262d-4985-b2e1-4c51ae925da9 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:24.362555 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1bab1-262d-4985-b2e1-4c51ae925da9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:24.370431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1bab1-262d-4985-b2e1-4c51ae925da9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:24.371959 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1bab1-262d-4985-b2e1-4c51ae925da9 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:24.383940 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-0ff1bab1-262d-4985-b2e1-4c51ae925da9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:29:24.383940 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:24.383940 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:24.383940 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:24.383940 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:24.383940 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:24.383940 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:24.383940 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:24.383940 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:24.383940 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:24.383940 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:24.383940 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:24.383940 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:29:24.383940 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:29:24.383940 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:29:24.383940 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:29:24.384998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:24.384998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:24.384998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:29:24.384998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:24.384998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:29:24.384998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:24.384998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:24.384998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:24.384998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:24.384998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:24.384998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:24.384998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:24.384998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:24.384998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:24.384998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:24.384998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:24.384998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:24.384998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:24.385910 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:24.385910 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:24.385910 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:29:24.385910 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:29:24.385910 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:29:24.385910 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:29:24.385910 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:29:24.385910 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:29:24.385910 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:29:24.385910 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:24.385910 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 275/553] 10.222.0.15 () {56 vars in 1093 bytes} [Mon Aug 22 20:29:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:24.385910 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1bab1-262d-4985-b2e1-4c51ae925da9 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:24.412821 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd2623-9822-4ce3-8404-f5681aed2f43 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:24.421346 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:24.448002 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd88039-31ab-4e7c-93ae-56c13d262114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:24.448638 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd88039-31ab-4e7c-93ae-56c13d262114 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:24.448918 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd88039-31ab-4e7c-93ae-56c13d262114 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:24.449216 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd88039-31ab-4e7c-93ae-56c13d262114 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:24.465470 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd88039-31ab-4e7c-93ae-56c13d262114 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:24.465470 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd88039-31ab-4e7c-93ae-56c13d262114 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:24.481838 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-ccd88039-31ab-4e7c-93ae-56c13d262114 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:24.481838 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:24.481838 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:24.481838 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:24.481838 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:24.481838 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:24.481838 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:24.481838 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:24.481838 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:24.481838 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:24.481838 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:24.481838 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:24.481838 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:24.481838 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:24.481838 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:24.481838 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:24.483191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:24.483191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:24.483191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:24.483191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:24.483191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:24.483191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:24.483191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:24.483191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:24.483191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:24.483191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:24.483191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:24.483191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:24.483191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:24.483191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:24.483191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:24.483191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:24.483191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:24.484904 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:24.484904 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:24.484904 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:24.484904 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 279/554] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:24.484904 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd88039-31ab-4e7c-93ae-56c13d262114 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:24.503711 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1bab1-262d-4985-b2e1-4c51ae925da9 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:24.550933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f337433-4a86-44e4-bd39-c2a8457e87d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:24.551606 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f337433-4a86-44e4-bd39-c2a8457e87d7 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:24.553721 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f337433-4a86-44e4-bd39-c2a8457e87d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:24.554013 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f337433-4a86-44e4-bd39-c2a8457e87d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:24.568342 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f337433-4a86-44e4-bd39-c2a8457e87d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:24.569877 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f337433-4a86-44e4-bd39-c2a8457e87d7 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:24.578350 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:24.587054 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-9f337433-4a86-44e4-bd39-c2a8457e87d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:24.587054 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:24.587054 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:24.587054 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:24.587054 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:24.587054 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:24.587054 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:24.587054 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:24.587054 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:24.587054 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:24.587054 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:24.587054 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:24.587054 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:24.587054 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:24.587054 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:24.587054 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:24.588242 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:24.588242 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:24.588242 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:24.588242 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:24.588242 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:24.588242 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:24.588242 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:24.588242 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:24.588242 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:24.588242 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:24.588242 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:24.588242 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:24.588242 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:24.588242 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:24.588242 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:24.588242 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:24.588242 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:24.589111 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:24.589111 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:24.589111 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:24.589111 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 276/555] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:24.589111 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f337433-4a86-44e4-bd39-c2a8457e87d7 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:24.605979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd88039-31ab-4e7c-93ae-56c13d262114 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:24.645241 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352d599-9a8f-4778-9c8f-ccca071d4cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:24.645986 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352d599-9a8f-4778-9c8f-ccca071d4cfa None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:24.646356 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352d599-9a8f-4778-9c8f-ccca071d4cfa None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:24.646718 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352d599-9a8f-4778-9c8f-ccca071d4cfa None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:24.647490 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352d599-9a8f-4778-9c8f-ccca071d4cfa None admin] RBAC: Adding query filter params (name=service) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:24.647964 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352d599-9a8f-4778-9c8f-ccca071d4cfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:24.649640 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352d599-9a8f-4778-9c8f-ccca071d4cfa None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:24.658452 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 280/556] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 20:29:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:24.659308 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352d599-9a8f-4778-9c8f-ccca071d4cfa None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:24.683296 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:24.700856 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f337433-4a86-44e4-bd39-c2a8457e87d7 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:24.740129 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec4666-9be6-439d-8899-94cf9e9205b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:24.740659 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec4666-9be6-439d-8899-94cf9e9205b3 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:24.740938 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec4666-9be6-439d-8899-94cf9e9205b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:24.741214 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec4666-9be6-439d-8899-94cf9e9205b3 None admin] PATH_INFO: `/v3/users` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:24.741960 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec4666-9be6-439d-8899-94cf9e9205b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:24.742269 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec4666-9be6-439d-8899-94cf9e9205b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:24.743829 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec4666-9be6-439d-8899-94cf9e9205b3 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:24.765754 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 277/557] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Aug 22 20:29:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:24.766620 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec4666-9be6-439d-8899-94cf9e9205b3 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:24.773291 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352d599-9a8f-4778-9c8f-ccca071d4cfa None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:24.810209 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1f26c-8edd-41c1-ad45-fd784ff9e592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:24.811875 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1f26c-8edd-41c1-ad45-fd784ff9e592 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:24.812148 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1f26c-8edd-41c1-ad45-fd784ff9e592 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:24.812421 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1f26c-8edd-41c1-ad45-fd784ff9e592 None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:24.813081 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1f26c-8edd-41c1-ad45-fd784ff9e592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:24.813386 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1f26c-8edd-41c1-ad45-fd784ff9e592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:24.814772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1f26c-8edd-41c1-ad45-fd784ff9e592 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:24.828522 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 281/558] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:24.829386 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1f26c-8edd-41c1-ad45-fd784ff9e592 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:24.833517 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:24.891767 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec4666-9be6-439d-8899-94cf9e9205b3 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:24.931303 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d01179-128d-4e75-a75d-ee07e122c1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:24.931934 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d01179-128d-4e75-a75d-ee07e122c1d3 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:24.932213 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d01179-128d-4e75-a75d-ee07e122c1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:24.932483 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d01179-128d-4e75-a75d-ee07e122c1d3 None admin] PATH_INFO: `/v3/domains` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:24.933133 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d01179-128d-4e75-a75d-ee07e122c1d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:24.933433 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d01179-128d-4e75-a75d-ee07e122c1d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:24.934821 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d01179-128d-4e75-a75d-ee07e122c1d3 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:24.937793 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1f26c-8edd-41c1-ad45-fd784ff9e592 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:24.950448 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 278/559] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:24.951417 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d01179-128d-4e75-a75d-ee07e122c1d3 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:24.955363 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:24.984795 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284fc2b-621c-48fa-a675-ea30040d9c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:24.985441 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284fc2b-621c-48fa-a675-ea30040d9c1c None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:24.985723 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284fc2b-621c-48fa-a675-ea30040d9c1c None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:24.986015 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284fc2b-621c-48fa-a675-ea30040d9c1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:24.996806 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284fc2b-621c-48fa-a675-ea30040d9c1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:24.998189 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284fc2b-621c-48fa-a675-ea30040d9c1c None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:25.015178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-3284fc2b-621c-48fa-a675-ea30040d9c1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:25.015178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:25.015178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:25.015178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:25.015178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:25.015178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:25.015178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:25.015178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:25.015178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:25.015178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:25.015178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:25.015178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:25.015178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:25.015178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:25.015178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:25.015178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:25.017082 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:25.017082 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:25.017082 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:25.017082 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:25.017082 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:25.017082 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:25.017082 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:25.017082 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:25.017082 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:25.017082 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:25.017082 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:25.017082 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:25.017082 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:25.017082 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:25.017082 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:25.017082 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:25.017082 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:25.018898 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:25.018898 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:25.018898 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:25.018898 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 282/560] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:25.018898 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284fc2b-621c-48fa-a675-ea30040d9c1c None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:25.070663 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d01179-128d-4e75-a75d-ee07e122c1d3 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:25.082021 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:25.107257 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540bc837-4e4b-4d0a-a55e-7ab3660196be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:25.108355 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bc837-4e4b-4d0a-a55e-7ab3660196be None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:25.108794 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bc837-4e4b-4d0a-a55e-7ab3660196be None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:25.109739 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bc837-4e4b-4d0a-a55e-7ab3660196be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:25.127002 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540bc837-4e4b-4d0a-a55e-7ab3660196be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:25.128464 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540bc837-4e4b-4d0a-a55e-7ab3660196be None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:25.134485 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284fc2b-621c-48fa-a675-ea30040d9c1c None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:25.143411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-540bc837-4e4b-4d0a-a55e-7ab3660196be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:25.143411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:25.143411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:25.143411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:25.143411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:25.143411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:25.143411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:25.143411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:25.143411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:25.143411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:25.143411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:25.143411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:25.143411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:25.143411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:25.143411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:25.143411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:25.144716 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:25.144716 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:25.144716 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:25.144716 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:25.144716 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:25.144716 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:25.144716 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:25.144716 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:25.144716 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:25.144716 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:25.144716 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:25.144716 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:25.144716 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:25.144716 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:25.144716 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:25.144716 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:25.144716 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:25.145769 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:25.145769 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:25.145769 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:25.145769 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 279/561] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:25.146178 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540bc837-4e4b-4d0a-a55e-7ab3660196be None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:25.175226 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45c9b8-17fc-4510-9688-57cd40cbb883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:25.175896 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45c9b8-17fc-4510-9688-57cd40cbb883 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:25.176178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45c9b8-17fc-4510-9688-57cd40cbb883 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:25.176450 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45c9b8-17fc-4510-9688-57cd40cbb883 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:25.183337 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45c9b8-17fc-4510-9688-57cd40cbb883 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:25.184956 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45c9b8-17fc-4510-9688-57cd40cbb883 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:25.196665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-9f45c9b8-17fc-4510-9688-57cd40cbb883 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:25.196665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:25.196665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:25.196665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:25.196665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:25.196665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:25.196665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:25.196665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:25.196665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:25.196665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:25.196665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:25.196665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:25.196665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:29:25.196665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:29:25.196665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:29:25.197772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:29:25.197772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:25.197772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:25.197772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:25.197772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:25.197772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:25.197772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:25.197772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:25.197772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:25.197772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:25.197772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:25.197772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:25.197772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:25.197772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:25.197772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:25.197772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:25.197772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:25.198881 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:29:25.198881 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:29:25.198881 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:29:25.198881 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:29:25.198881 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:29:25.198881 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:29:25.198881 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:25.198881 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:25.198881 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 283/562] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:25.199704 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45c9b8-17fc-4510-9688-57cd40cbb883 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:25.240688 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:25.313725 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45c9b8-17fc-4510-9688-57cd40cbb883 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:25.317630 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540bc837-4e4b-4d0a-a55e-7ab3660196be None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:25.331279 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:25.350007 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab66a85-1232-4e31-87fa-d3b0d190a2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:25.350612 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab66a85-1232-4e31-87fa-d3b0d190a2a9 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:25.350887 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab66a85-1232-4e31-87fa-d3b0d190a2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:25.351159 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab66a85-1232-4e31-87fa-d3b0d190a2a9 None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:25.351849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab66a85-1232-4e31-87fa-d3b0d190a2a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:25.352152 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab66a85-1232-4e31-87fa-d3b0d190a2a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:25.353591 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab66a85-1232-4e31-87fa-d3b0d190a2a9 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:25.367567 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 284/563] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:25.368426 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab66a85-1232-4e31-87fa-d3b0d190a2a9 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:25.375705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24db62c-ec97-4c87-b4fe-1751b56d31ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:25.376343 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24db62c-ec97-4c87-b4fe-1751b56d31ab None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:25.376623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24db62c-ec97-4c87-b4fe-1751b56d31ab None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:25.376894 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24db62c-ec97-4c87-b4fe-1751b56d31ab None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:25.386758 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24db62c-ec97-4c87-b4fe-1751b56d31ab None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:25.388290 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24db62c-ec97-4c87-b4fe-1751b56d31ab None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:25.400480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-d24db62c-ec97-4c87-b4fe-1751b56d31ab None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 20:29:25.400480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:25.400480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:25.400480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:25.400480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:25.400480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:25.400480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:25.400480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:25.400480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:25.400480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:25.400480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:25.400480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:25.400480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:29:25.400480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:29:25.400480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:29:25.400480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:29:25.405808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:25.405808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:25.405808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:29:25.405808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:25.405808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:29:25.405808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:25.405808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:25.405808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:25.405808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:25.405808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:25.405808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:25.405808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:25.405808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:25.405808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:25.405808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:25.405808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:25.405808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:25.405808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:25.406900 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:25.406900 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:25.406900 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:29:25.406900 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:29:25.406900 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:29:25.406900 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:29:25.406900 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:29:25.406900 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:29:25.406900 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 20:29:25.406900 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:25.406900 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 280/564] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 20:29:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:25.406900 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24db62c-ec97-4c87-b4fe-1751b56d31ab None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:25.486095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab66a85-1232-4e31-87fa-d3b0d190a2a9 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:25.523446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538df99e-0f66-47b1-abbe-db69bc7d379f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:25.524093 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538df99e-0f66-47b1-abbe-db69bc7d379f None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:25.524394 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538df99e-0f66-47b1-abbe-db69bc7d379f None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:25.524640 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538df99e-0f66-47b1-abbe-db69bc7d379f None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:25.525301 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538df99e-0f66-47b1-abbe-db69bc7d379f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:25.525609 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538df99e-0f66-47b1-abbe-db69bc7d379f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:25.526990 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538df99e-0f66-47b1-abbe-db69bc7d379f None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:25.528104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24db62c-ec97-4c87-b4fe-1751b56d31ab None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:25.542111 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 285/565] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:25.542111 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538df99e-0f66-47b1-abbe-db69bc7d379f None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:25.556731 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:25.579154 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:25.582943 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec30474-b4c7-4e31-a848-3d1dec8bd902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:25.583308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec30474-b4c7-4e31-a848-3d1dec8bd902 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:25.583743 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec30474-b4c7-4e31-a848-3d1dec8bd902 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:25.584002 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec30474-b4c7-4e31-a848-3d1dec8bd902 None admin] PATH_INFO: `/v3/projects` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:25.584690 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec30474-b4c7-4e31-a848-3d1dec8bd902 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:25.584994 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec30474-b4c7-4e31-a848-3d1dec8bd902 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:25.586439 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec30474-b4c7-4e31-a848-3d1dec8bd902 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:25.601179 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 281/566] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 20:29:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:25.602055 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec30474-b4c7-4e31-a848-3d1dec8bd902 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:25.653963 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538df99e-0f66-47b1-abbe-db69bc7d379f None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:25.696095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a6263-fde5-49fa-974a-885d3ace0f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:25.696789 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a6263-fde5-49fa-974a-885d3ace0f4f None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:25.697107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a6263-fde5-49fa-974a-885d3ace0f4f None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:25.697392 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a6263-fde5-49fa-974a-885d3ace0f4f None admin] PATH_INFO: `/v3/users/glance` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:25.706784 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a6263-fde5-49fa-974a-885d3ace0f4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:25.708358 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a6263-fde5-49fa-974a-885d3ace0f4f None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:25.721429 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-bf8a6263-fde5-49fa-974a-885d3ace0f4f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 20:29:25.721429 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:25.721429 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:25.721429 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:25.721429 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:25.721429 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:25.721429 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:25.721429 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:25.721429 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:25.721429 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:25.721429 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:25.721429 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:25.721429 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:29:25.721429 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:29:25.721429 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:29:25.721429 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:29:25.723232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:25.723232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:25.723232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:29:25.723232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:25.723232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:29:25.723232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:25.723232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:25.723232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:25.723232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:25.723232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:25.723232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:25.723232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:25.723232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:25.723232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:25.723232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:25.723232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:25.723232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:25.723232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:25.725111 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:25.725111 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:25.725111 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:29:25.725111 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:29:25.725111 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:29:25.725111 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:29:25.725111 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:29:25.725111 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:29:25.725111 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 20:29:25.725111 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:25.725111 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 286/567] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:29:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:25.725111 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a6263-fde5-49fa-974a-885d3ace0f4f None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:25.737912 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec30474-b4c7-4e31-a848-3d1dec8bd902 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:25.783333 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb997f-0e94-4916-a09c-56034069c2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:25.783992 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb997f-0e94-4916-a09c-56034069c2e0 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:25.784282 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb997f-0e94-4916-a09c-56034069c2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:25.784560 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb997f-0e94-4916-a09c-56034069c2e0 None admin] PATH_INFO: `/v3/users` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:25.785303 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb997f-0e94-4916-a09c-56034069c2e0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:25.785611 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb997f-0e94-4916-a09c-56034069c2e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:25.787190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb997f-0e94-4916-a09c-56034069c2e0 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:25.808682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 282/568] 10.222.0.15 () {56 vars in 1139 bytes} [Mon Aug 22 20:29:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:25.809539 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb997f-0e94-4916-a09c-56034069c2e0 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:25.847068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:25.849212 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:25.853858 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a6263-fde5-49fa-974a-885d3ace0f4f None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:25.891530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88595b-d4d1-46a3-bfbe-92c9fa9ff8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:25.893380 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88595b-d4d1-46a3-bfbe-92c9fa9ff8fc None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:25.893380 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88595b-d4d1-46a3-bfbe-92c9fa9ff8fc None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:25.893380 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88595b-d4d1-46a3-bfbe-92c9fa9ff8fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:25.900762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88595b-d4d1-46a3-bfbe-92c9fa9ff8fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:25.902303 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88595b-d4d1-46a3-bfbe-92c9fa9ff8fc None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:25.914648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-de88595b-d4d1-46a3-bfbe-92c9fa9ff8fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:25.914648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:25.914648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:25.914648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:25.914648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:25.914648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:25.914648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:25.914648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:25.914648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:25.914648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:25.914648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:25.914648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:25.914648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:29:25.914648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:29:25.914648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:29:25.920962 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:29:25.920962 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:25.920962 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:25.920962 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:25.920962 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:25.920962 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:25.920962 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:25.920962 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:25.920962 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:25.920962 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:25.920962 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:25.920962 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:25.920962 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:25.920962 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:25.920962 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:25.920962 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:25.920962 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:25.922139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:29:25.922139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:29:25.922139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:29:25.922139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:29:25.922139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:29:25.922139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:29:25.922139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:25.922139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:25.922139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 287/569] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:25.922139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88595b-d4d1-46a3-bfbe-92c9fa9ff8fc None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:25.933688 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb997f-0e94-4916-a09c-56034069c2e0 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:25.974000 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bcd90-0463-43a7-ae22-944a95803499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:25.974695 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bcd90-0463-43a7-ae22-944a95803499 None admin] REQUEST_METHOD: `PUT` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:25.974973 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bcd90-0463-43a7-ae22-944a95803499 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:25.975244 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bcd90-0463-43a7-ae22-944a95803499 None admin] PATH_INFO: `/v3/projects/7bda5c44ace24608b8ca69e9059d73ef/users/d0b7833b75334bceb549f7184041aacc/roles/b92ee6686fe5412f9b7fdf27fb4c21d3` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:25.990949 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bcd90-0463-43a7-ae22-944a95803499 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bda5c44ace24608b8ca69e9059d73ef, user_id=d0b7833b75334bceb549f7184041aacc, role_id=b92ee6686fe5412f9b7fdf27fb4c21d3)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:25.992555 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bcd90-0463-43a7-ae22-944a95803499 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:26.027475 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88595b-d4d1-46a3-bfbe-92c9fa9ff8fc None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:26.062655 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 283/570] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 20:29:25 2022] PUT /identity/v3/projects/7bda5c44ace24608b8ca69e9059d73ef/users/d0b7833b75334bceb549f7184041aacc/roles/b92ee6686fe5412f9b7fdf27fb4c21d3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:29:26.063513 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bcd90-0463-43a7-ae22-944a95803499 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:26.069453 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4038f31-0f00-4497-af61-cb00283fbb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:26.070194 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4038f31-0f00-4497-af61-cb00283fbb86 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:26.070539 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4038f31-0f00-4497-af61-cb00283fbb86 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:26.070878 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4038f31-0f00-4497-af61-cb00283fbb86 None admin] PATH_INFO: `/v3/users` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:26.071820 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4038f31-0f00-4497-af61-cb00283fbb86 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:26.072203 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4038f31-0f00-4497-af61-cb00283fbb86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:26.073734 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4038f31-0f00-4497-af61-cb00283fbb86 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:26.103110 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 288/571] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Aug 22 20:29:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:26.104250 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4038f31-0f00-4497-af61-cb00283fbb86 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:26.123979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:26.179883 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:26.202280 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bcd90-0463-43a7-ae22-944a95803499 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:26.246785 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4038f31-0f00-4497-af61-cb00283fbb86 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:26.247039 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936fe55-6b26-4236-9bc0-c138ed6857ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:26.247574 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936fe55-6b26-4236-9bc0-c138ed6857ff None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:26.247854 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936fe55-6b26-4236-9bc0-c138ed6857ff None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:26.248126 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936fe55-6b26-4236-9bc0-c138ed6857ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:26.268005 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936fe55-6b26-4236-9bc0-c138ed6857ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:26.269532 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936fe55-6b26-4236-9bc0-c138ed6857ff None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:26.292018 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-f936fe55-6b26-4236-9bc0-c138ed6857ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:26.292018 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:26.292018 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:26.292018 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:26.292018 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:26.292018 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:26.292018 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:26.292018 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:26.292018 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:26.292018 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:26.292018 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:26.292018 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:26.292018 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:26.292018 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:26.292018 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:26.292018 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:26.293232 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:26.293232 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:26.293232 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:26.293232 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:26.293232 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:26.293232 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:26.293232 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:26.293232 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:26.293232 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:26.293232 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:26.293232 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:26.293232 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:26.293232 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:26.293232 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:26.293232 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:26.293232 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:26.293232 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:26.294361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:26.294361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:26.294361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:26.294622 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28dce8-016a-46d1-af5c-caabfb4ff7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:26.294622 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28dce8-016a-46d1-af5c-caabfb4ff7bd None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:26.294622 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28dce8-016a-46d1-af5c-caabfb4ff7bd None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:26.294622 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28dce8-016a-46d1-af5c-caabfb4ff7bd None admin] PATH_INFO: `/v3/projects` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:26.294996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28dce8-016a-46d1-af5c-caabfb4ff7bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:26.294996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28dce8-016a-46d1-af5c-caabfb4ff7bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:26.296588 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 284/572] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:26.301421 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28dce8-016a-46d1-af5c-caabfb4ff7bd None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:26.301592 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936fe55-6b26-4236-9bc0-c138ed6857ff None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:26.312567 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 289/573] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 20:29:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:26.313443 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28dce8-016a-46d1-af5c-caabfb4ff7bd None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:26.402094 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:26.423834 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936fe55-6b26-4236-9bc0-c138ed6857ff None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:26.434556 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28dce8-016a-46d1-af5c-caabfb4ff7bd None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:26.468090 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903735f-67cd-4d57-b892-5e32781d1632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:26.468740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903735f-67cd-4d57-b892-5e32781d1632 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:26.468740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903735f-67cd-4d57-b892-5e32781d1632 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:26.468740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903735f-67cd-4d57-b892-5e32781d1632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:26.471660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:26.474504 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fd4f8-d4d9-4a88-8dc1-6ccf186aa229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:26.475125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fd4f8-d4d9-4a88-8dc1-6ccf186aa229 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:26.475401 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fd4f8-d4d9-4a88-8dc1-6ccf186aa229 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:26.475703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fd4f8-d4d9-4a88-8dc1-6ccf186aa229 None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:26.476355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fd4f8-d4d9-4a88-8dc1-6ccf186aa229 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:26.476819 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fd4f8-d4d9-4a88-8dc1-6ccf186aa229 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:26.478124 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fd4f8-d4d9-4a88-8dc1-6ccf186aa229 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:26.482276 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903735f-67cd-4d57-b892-5e32781d1632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:26.486210 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903735f-67cd-4d57-b892-5e32781d1632 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:26.494769 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 290/574] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:26.500436 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fd4f8-d4d9-4a88-8dc1-6ccf186aa229 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:26.506380 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-3903735f-67cd-4d57-b892-5e32781d1632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:26.506380 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:26.506380 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:26.506380 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:26.506380 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:26.506380 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:26.506380 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:26.506380 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:26.506380 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:26.506380 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:26.506380 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:26.506380 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:26.506380 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:26.506380 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:26.506380 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:26.506380 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:26.508113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:26.508113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:26.508113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:26.508113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:26.508113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:26.508113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:26.508113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:26.508113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:26.508113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:26.508113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:26.508113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:26.508113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:26.508113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:26.508113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:26.508113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:26.508113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:26.508113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:26.509021 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:26.509021 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:26.509021 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:26.512167 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 285/575] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:26.513003 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903735f-67cd-4d57-b892-5e32781d1632 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:26.628475 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fd4f8-d4d9-4a88-8dc1-6ccf186aa229 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:26.642344 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903735f-67cd-4d57-b892-5e32781d1632 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:26.675536 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f1e3d-5847-4723-8656-06a9fe0cd011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:26.676490 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f1e3d-5847-4723-8656-06a9fe0cd011 None admin] REQUEST_METHOD: `PUT` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:26.676928 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f1e3d-5847-4723-8656-06a9fe0cd011 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:26.677204 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f1e3d-5847-4723-8656-06a9fe0cd011 None admin] PATH_INFO: `/v3/projects/7bda5c44ace24608b8ca69e9059d73ef/users/c18d1768fb7a4bac93b28d095b74caf6/roles/b92ee6686fe5412f9b7fdf27fb4c21d3` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:26.679991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:26.689251 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca87e0-f77d-4dee-929b-653974f649fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:26.689876 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca87e0-f77d-4dee-929b-653974f649fa None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:26.690157 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca87e0-f77d-4dee-929b-653974f649fa None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:26.700937 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca87e0-f77d-4dee-929b-653974f649fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:26.701095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f1e3d-5847-4723-8656-06a9fe0cd011 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bda5c44ace24608b8ca69e9059d73ef, user_id=c18d1768fb7a4bac93b28d095b74caf6, role_id=b92ee6686fe5412f9b7fdf27fb4c21d3)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:26.701095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f1e3d-5847-4723-8656-06a9fe0cd011 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:26.703539 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca87e0-f77d-4dee-929b-653974f649fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:26.705062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca87e0-f77d-4dee-929b-653974f649fa None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:26.718116 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-56ca87e0-f77d-4dee-929b-653974f649fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:26.718116 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:26.718116 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:26.718116 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:26.718116 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:26.718116 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:26.718116 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:26.718116 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:26.718116 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:26.718116 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:26.718116 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:26.718116 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:26.718116 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:29:26.718116 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:29:26.718116 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:29:26.719109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:29:26.719109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:26.719109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:26.719109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:26.719109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:26.719109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:26.719109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:26.719109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:26.719109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:26.719109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:26.719109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:26.719109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:26.719109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:26.719109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:26.719109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:26.719109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:26.719109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:26.720013 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:29:26.720013 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:29:26.720013 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:29:26.720013 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:29:26.720013 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:29:26.720013 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:29:26.720013 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:26.720013 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:26.720013 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 286/576] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:26.720474 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca87e0-f77d-4dee-929b-653974f649fa None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:26.773944 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:26.819894 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 291/577] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 20:29:26 2022] PUT /identity/v3/projects/7bda5c44ace24608b8ca69e9059d73ef/users/c18d1768fb7a4bac93b28d095b74caf6/roles/b92ee6686fe5412f9b7fdf27fb4c21d3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:29:26.821128 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f1e3d-5847-4723-8656-06a9fe0cd011 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:26.838934 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca87e0-f77d-4dee-929b-653974f649fa None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:26.885785 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe086f-95ab-463b-a655-6354100063ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:26.886206 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe086f-95ab-463b-a655-6354100063ef None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:26.886537 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe086f-95ab-463b-a655-6354100063ef None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:26.886811 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe086f-95ab-463b-a655-6354100063ef None admin] PATH_INFO: `/v3/domains` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:26.887610 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe086f-95ab-463b-a655-6354100063ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:26.887923 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe086f-95ab-463b-a655-6354100063ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:26.889802 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe086f-95ab-463b-a655-6354100063ef None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:26.906322 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 287/578] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:26.912316 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe086f-95ab-463b-a655-6354100063ef None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:26.988330 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f1e3d-5847-4723-8656-06a9fe0cd011 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:27.037655 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e320a-ee90-4c73-a99c-9ce3598f3c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:27.038438 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e320a-ee90-4c73-a99c-9ce3598f3c7a None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:27.038792 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e320a-ee90-4c73-a99c-9ce3598f3c7a None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:27.039068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e320a-ee90-4c73-a99c-9ce3598f3c7a None admin] PATH_INFO: `/v3/projects` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:27.040462 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e320a-ee90-4c73-a99c-9ce3598f3c7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:27.040893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e320a-ee90-4c73-a99c-9ce3598f3c7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:27.046547 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e320a-ee90-4c73-a99c-9ce3598f3c7a None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:27.057907 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 292/579] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 20:29:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:27.065129 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e320a-ee90-4c73-a99c-9ce3598f3c7a None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:27.072009 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe086f-95ab-463b-a655-6354100063ef None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:27.082728 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:27.121993 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ea246-a613-43ad-8460-a131266f9f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:27.122881 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ea246-a613-43ad-8460-a131266f9f41 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:27.123293 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ea246-a613-43ad-8460-a131266f9f41 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:27.124307 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ea246-a613-43ad-8460-a131266f9f41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:27.130732 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:27.134534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ea246-a613-43ad-8460-a131266f9f41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:27.136632 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ea246-a613-43ad-8460-a131266f9f41 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:27.158134 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-d30ea246-a613-43ad-8460-a131266f9f41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:27.158134 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:27.158134 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:27.158134 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:27.158134 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:27.158134 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:27.158134 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:27.158134 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:27.158134 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:27.158134 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:27.158134 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:27.158134 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:27.158134 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:29:27.158134 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:29:27.158134 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:29:27.159311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:29:27.159311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:27.159311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:27.159311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:27.159311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:27.159311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:27.159311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:27.159311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:27.159311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:27.159311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:27.159311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:27.159311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:27.159311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:27.159311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:27.159311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:27.159311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:27.159311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:27.160516 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:29:27.160516 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:29:27.160516 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:29:27.160516 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:29:27.160516 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:29:27.160516 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:29:27.160516 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:27.160516 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:27.163962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 288/580] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:27.169161 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ea246-a613-43ad-8460-a131266f9f41 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:27.225253 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e320a-ee90-4c73-a99c-9ce3598f3c7a None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:27.277047 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf79343-5534-40be-9fdd-04bafe71d570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:27.278059 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf79343-5534-40be-9fdd-04bafe71d570 None admin] REQUEST_METHOD: `PUT` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:27.278437 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf79343-5534-40be-9fdd-04bafe71d570 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:27.278812 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf79343-5534-40be-9fdd-04bafe71d570 None admin] PATH_INFO: `/v3/projects/7bda5c44ace24608b8ca69e9059d73ef/users/340a791917d14686bb14e13544c1ce9b/roles/b92ee6686fe5412f9b7fdf27fb4c21d3` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:27.297481 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ea246-a613-43ad-8460-a131266f9f41 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:27.298927 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf79343-5534-40be-9fdd-04bafe71d570 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bda5c44ace24608b8ca69e9059d73ef, user_id=340a791917d14686bb14e13544c1ce9b, role_id=b92ee6686fe5412f9b7fdf27fb4c21d3)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:27.301523 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf79343-5534-40be-9fdd-04bafe71d570 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:27.338951 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b89e1-dfdb-4a91-b071-1370adea3243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:27.339583 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b89e1-dfdb-4a91-b071-1370adea3243 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:27.339849 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b89e1-dfdb-4a91-b071-1370adea3243 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:27.340183 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b89e1-dfdb-4a91-b071-1370adea3243 None admin] PATH_INFO: `/v3/projects` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:27.340880 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b89e1-dfdb-4a91-b071-1370adea3243 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:27.341263 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b89e1-dfdb-4a91-b071-1370adea3243 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:27.343235 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b89e1-dfdb-4a91-b071-1370adea3243 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:27.361761 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 289/581] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 20:29:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:27.364848 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b89e1-dfdb-4a91-b071-1370adea3243 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:27.397028 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:27.459654 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 293/582] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 20:29:27 2022] PUT /identity/v3/projects/7bda5c44ace24608b8ca69e9059d73ef/users/340a791917d14686bb14e13544c1ce9b/roles/b92ee6686fe5412f9b7fdf27fb4c21d3 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:29:27.497435 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b89e1-dfdb-4a91-b071-1370adea3243 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:27.541489 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ba507-052b-44f7-8c55-2d89d13e92a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:27.542573 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ba507-052b-44f7-8c55-2d89d13e92a8 None admin] REQUEST_METHOD: `PUT` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:27.543211 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ba507-052b-44f7-8c55-2d89d13e92a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:27.543733 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ba507-052b-44f7-8c55-2d89d13e92a8 None admin] PATH_INFO: `/v3/projects/7bda5c44ace24608b8ca69e9059d73ef/users/dcac07ea52e44b7cb7df360dbec74254/roles/b92ee6686fe5412f9b7fdf27fb4c21d3` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:27.562907 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ba507-052b-44f7-8c55-2d89d13e92a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bda5c44ace24608b8ca69e9059d73ef, user_id=dcac07ea52e44b7cb7df360dbec74254, role_id=b92ee6686fe5412f9b7fdf27fb4c21d3)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:27.565135 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ba507-052b-44f7-8c55-2d89d13e92a8 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:27.677381 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 290/583] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 20:29:27 2022] PUT /identity/v3/projects/7bda5c44ace24608b8ca69e9059d73ef/users/dcac07ea52e44b7cb7df360dbec74254/roles/b92ee6686fe5412f9b7fdf27fb4c21d3 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:29:28.385235 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38b15c-3d7a-44bf-89d0-3fd5dd9b5878 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:28.385637 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38b15c-3d7a-44bf-89d0-3fd5dd9b5878 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:28.385825 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38b15c-3d7a-44bf-89d0-3fd5dd9b5878 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:28.387444 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 294/584] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:28.393270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc073f59-5a2b-456e-9be9-1b351c6e80d6 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:28.393561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc073f59-5a2b-456e-9be9-1b351c6e80d6 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:28.393837 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc073f59-5a2b-456e-9be9-1b351c6e80d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:28.416943 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-fc073f59-5a2b-456e-9be9-1b351c6e80d6 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:28.418286 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-fc073f59-5a2b-456e-9be9-1b351c6e80d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:28.543591 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 291/585] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:29:28.895931 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38b15c-3d7a-44bf-89d0-3fd5dd9b5878 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:29.007163 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:29.015226 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38b15c-3d7a-44bf-89d0-3fd5dd9b5878 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:29.050042 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478e78a-7303-4c78-a3c1-e9e9ff201af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:29.050672 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478e78a-7303-4c78-a3c1-e9e9ff201af0 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:29.050947 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478e78a-7303-4c78-a3c1-e9e9ff201af0 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:29.051211 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478e78a-7303-4c78-a3c1-e9e9ff201af0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:29.063044 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478e78a-7303-4c78-a3c1-e9e9ff201af0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:29.068296 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-f478e78a-7303-4c78-a3c1-e9e9ff201af0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:29.068296 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:29.068296 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:29.068296 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:29.068296 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:29.068296 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:29.068296 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:29.068296 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:29.068296 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:29.068296 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:29.068296 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:29.068296 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:29.068296 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:29.068296 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:29.068296 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:29.068296 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:29.069369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:29.069369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:29.069369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:29.069369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:29.069369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:29.069369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:29.069369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:29.069369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:29.069369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:29.069369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:29.069369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:29.069369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:29.069369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:29.069369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:29.069369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:29.069369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:29.070381 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:29.070381 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:29.070381 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:29.070381 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:29.070381 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:29.070381 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:29.070381 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:29.070381 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:29.070381 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:29.070381 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:29.070381 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:29.070381 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:29.070381 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 295/586] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 20:29:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:29.075619 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc073f59-5a2b-456e-9be9-1b351c6e80d6 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:29.085279 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:29.141903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66670538-1681-41a9-83f5-3345179bf5e9 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:29.142256 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66670538-1681-41a9-83f5-3345179bf5e9 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:29.142457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66670538-1681-41a9-83f5-3345179bf5e9 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:29.144051 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 296/587] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:29:29.149333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c1374-aba9-49f6-b48d-3ed25f1ee38a None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:29.149545 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c1374-aba9-49f6-b48d-3ed25f1ee38a None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:29.149823 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c1374-aba9-49f6-b48d-3ed25f1ee38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:29.168278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-2e0c1374-aba9-49f6-b48d-3ed25f1ee38a None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:29.169481 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-2e0c1374-aba9-49f6-b48d-3ed25f1ee38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:29.194816 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc073f59-5a2b-456e-9be9-1b351c6e80d6 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:29.235860 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549451b-b40e-45e8-8458-5abbfa6e845f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:29.236471 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549451b-b40e-45e8-8458-5abbfa6e845f None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:29.236797 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549451b-b40e-45e8-8458-5abbfa6e845f None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:29.237075 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549451b-b40e-45e8-8458-5abbfa6e845f None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:29.237737 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549451b-b40e-45e8-8458-5abbfa6e845f None admin] RBAC: Adding query filter params (name=service) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:29.238043 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549451b-b40e-45e8-8458-5abbfa6e845f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:29.239487 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549451b-b40e-45e8-8458-5abbfa6e845f None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:29.249093 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 292/588] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 20:29:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:29.254304 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549451b-b40e-45e8-8458-5abbfa6e845f None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:29.254722 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 297/589] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:29:29.325430 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:29.360036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549451b-b40e-45e8-8458-5abbfa6e845f None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:29.395885 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefbc58-92b8-4ded-9753-2b09095585da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:29.396516 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefbc58-92b8-4ded-9753-2b09095585da None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:29.396789 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefbc58-92b8-4ded-9753-2b09095585da None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:29.397058 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefbc58-92b8-4ded-9753-2b09095585da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:29.408601 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefbc58-92b8-4ded-9753-2b09095585da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:29.410129 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefbc58-92b8-4ded-9753-2b09095585da None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:29.425486 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-4fefbc58-92b8-4ded-9753-2b09095585da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:29.425486 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:29.425486 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:29.425486 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:29.425486 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:29.425486 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:29.425486 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:29.425486 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:29.425486 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:29.425486 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:29.425486 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:29.425486 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:29.425486 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:29.425486 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:29.425486 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:29.425486 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:29.426478 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:29.426478 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:29.426478 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:29.426478 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:29.426478 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:29.426478 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:29.426478 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:29.426478 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:29.426478 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:29.426478 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:29.426478 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:29.426478 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:29.426478 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:29.426478 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:29.426478 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:29.426478 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:29.426478 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:29.427348 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:29.427348 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:29.427348 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:29.427348 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 293/590] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:29.432281 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c1374-aba9-49f6-b48d-3ed25f1ee38a None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:29.521129 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:29.550212 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c1374-aba9-49f6-b48d-3ed25f1ee38a None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:29.586988 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d3fd9-e44e-4c98-9410-1aac42701c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:29.587637 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d3fd9-e44e-4c98-9410-1aac42701c68 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:29.588032 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d3fd9-e44e-4c98-9410-1aac42701c68 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:29.588477 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d3fd9-e44e-4c98-9410-1aac42701c68 None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:29.589378 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d3fd9-e44e-4c98-9410-1aac42701c68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:29.589901 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d3fd9-e44e-4c98-9410-1aac42701c68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:29.591777 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d3fd9-e44e-4c98-9410-1aac42701c68 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:29.610315 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 298/591] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:29.613675 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefbc58-92b8-4ded-9753-2b09095585da None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:29.615587 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d3fd9-e44e-4c98-9410-1aac42701c68 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:29.720052 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d3fd9-e44e-4c98-9410-1aac42701c68 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:29.724020 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefbc58-92b8-4ded-9753-2b09095585da None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:29.746391 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:29.758156 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7fbe3-1c82-4565-900b-aa82c70cfa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:29.758865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7fbe3-1c82-4565-900b-aa82c70cfa67 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:29.759150 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7fbe3-1c82-4565-900b-aa82c70cfa67 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:29.759419 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7fbe3-1c82-4565-900b-aa82c70cfa67 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:29.767982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834bafb-5480-4eb5-a126-abf687577a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:29.767982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834bafb-5480-4eb5-a126-abf687577a8b None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:29.767982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834bafb-5480-4eb5-a126-abf687577a8b None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:29.767982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834bafb-5480-4eb5-a126-abf687577a8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:29.768301 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7fbe3-1c82-4565-900b-aa82c70cfa67 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:29.769148 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7fbe3-1c82-4565-900b-aa82c70cfa67 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:29.777476 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834bafb-5480-4eb5-a126-abf687577a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:29.781428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-29b7fbe3-1c82-4565-900b-aa82c70cfa67 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:29:29.781428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:29.781428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:29.781428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:29.781428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:29.781428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:29.781428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:29.781428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:29.781428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:29.781428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:29.781428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:29.781428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:29.781428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:29:29.781428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:29:29.781428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:29:29.781428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:29:29.782467 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:29.782467 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:29.782467 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:29:29.782467 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:29.782467 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:29:29.782467 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:29.782467 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:29.782467 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:29.782467 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:29.782467 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:29.782467 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:29.782467 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:29.782467 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:29.782467 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:29.782467 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:29.782467 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:29.782467 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:29.782467 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:29.783405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:29.783405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:29.783405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:29:29.783405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:29:29.783405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:29:29.783405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:29:29.783405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:29:29.783405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:29:29.783405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:29:29.783405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:29.783405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 299/592] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:29:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:29:29.784438 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-a834bafb-5480-4eb5-a126-abf687577a8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:29.784438 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:29.784438 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:29.784438 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:29.784438 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:29.784438 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:29.784438 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:29.784438 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:29.784438 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:29.784438 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:29.784438 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:29.784438 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:29.784438 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:29.784438 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:29.784438 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:29.784438 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:29.785277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:29.785277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:29.785277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:29.785277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:29.785277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:29.785277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:29.785277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:29.785277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:29.785277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:29.785277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:29.785277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:29.785277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:29.785277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:29.785277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:29.785277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:29.785277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:29.787358 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:29.787358 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:29.787358 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:29.787358 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:29.787358 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:29.787358 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:29.787358 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:29.787358 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:29.787358 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:29.787358 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:29.787358 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:29.787358 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:29.787358 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 294/593] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 20:29:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:29.794694 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7fbe3-1c82-4565-900b-aa82c70cfa67 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:29.797052 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834bafb-5480-4eb5-a126-abf687577a8b None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:29.798272 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:29.922109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834bafb-5480-4eb5-a126-abf687577a8b None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:29.928438 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7fbe3-1c82-4565-900b-aa82c70cfa67 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:29.962470 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce41bae-0c86-46b3-8ac9-1a951701cde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:29.963475 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce41bae-0c86-46b3-8ac9-1a951701cde3 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:29.964014 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce41bae-0c86-46b3-8ac9-1a951701cde3 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:29.964487 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce41bae-0c86-46b3-8ac9-1a951701cde3 None admin] PATH_INFO: `/v3/users` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:29.965548 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce41bae-0c86-46b3-8ac9-1a951701cde3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:29.966085 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce41bae-0c86-46b3-8ac9-1a951701cde3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:29.968579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce41bae-0c86-46b3-8ac9-1a951701cde3 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:29.976035 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f75bc-bd28-4cca-aabd-733c2ef79864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:29.976575 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f75bc-bd28-4cca-aabd-733c2ef79864 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:29.976852 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f75bc-bd28-4cca-aabd-733c2ef79864 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:29.977122 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f75bc-bd28-4cca-aabd-733c2ef79864 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:29.977812 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f75bc-bd28-4cca-aabd-733c2ef79864 None admin] RBAC: Adding query filter params (name=service) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:29.978124 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f75bc-bd28-4cca-aabd-733c2ef79864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:29.980045 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f75bc-bd28-4cca-aabd-733c2ef79864 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:29.991975 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 295/594] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Aug 22 20:29:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:29.993545 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b015d-726b-4b95-ad2a-7b553b732cbd None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:29.994030 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b015d-726b-4b95-ad2a-7b553b732cbd None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:29.994525 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b015d-726b-4b95-ad2a-7b553b732cbd None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:29.996229 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 296/595] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:29.996845 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 300/596] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 20:29:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:29.997517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b015d-726b-4b95-ad2a-7b553b732cbd None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:29.998344 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f75bc-bd28-4cca-aabd-733c2ef79864 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:30.044092 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:30.071973 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:30.108600 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f75bc-bd28-4cca-aabd-733c2ef79864 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:30.119049 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b015d-726b-4b95-ad2a-7b553b732cbd None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:30.145267 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f5e20-92f7-4e03-b490-9f9d0f18c4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:30.145893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f5e20-92f7-4e03-b490-9f9d0f18c4ee None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:30.146178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f5e20-92f7-4e03-b490-9f9d0f18c4ee None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:30.146443 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f5e20-92f7-4e03-b490-9f9d0f18c4ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:30.154607 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375c7b0-9efb-4b46-8b30-f064be402f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:30.155238 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375c7b0-9efb-4b46-8b30-f064be402f18 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:30.155517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375c7b0-9efb-4b46-8b30-f064be402f18 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:30.155816 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375c7b0-9efb-4b46-8b30-f064be402f18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:30.157050 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f5e20-92f7-4e03-b490-9f9d0f18c4ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:30.158529 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f5e20-92f7-4e03-b490-9f9d0f18c4ee None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:30.173641 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-3b9f5e20-92f7-4e03-b490-9f9d0f18c4ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:30.173641 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:30.173641 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:30.173641 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:30.173641 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:30.173641 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:30.173641 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:30.173641 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:30.173641 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:30.173641 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:30.173641 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:30.173641 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:30.173641 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:30.173641 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:30.173641 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:30.173641 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:30.174787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:30.174787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:30.174787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:30.174787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:30.174787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:30.174787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:30.174787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:30.174787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:30.174787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:30.174787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:30.174787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:30.174787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:30.174787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:30.174787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:30.174787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:30.174787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:30.174787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:30.175727 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:30.175727 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:30.175727 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:30.175727 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 301/597] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:29:30.175966 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da05f0-8764-47ba-87e5-8a2b1f63adff None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:30.176397 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da05f0-8764-47ba-87e5-8a2b1f63adff None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:30.176499 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da05f0-8764-47ba-87e5-8a2b1f63adff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:30.194671 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-63da05f0-8764-47ba-87e5-8a2b1f63adff None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:30.195899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-63da05f0-8764-47ba-87e5-8a2b1f63adff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:30.231343 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375c7b0-9efb-4b46-8b30-f064be402f18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:30.233284 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375c7b0-9efb-4b46-8b30-f064be402f18 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:30.263029 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 302/598] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:29:30.264363 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b5ad0-ec67-4217-ac4d-7ac7fe030e19 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:30.264650 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b5ad0-ec67-4217-ac4d-7ac7fe030e19 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:30.264923 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b5ad0-ec67-4217-ac4d-7ac7fe030e19 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:30.266193 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 303/599] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:30.268325 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b5ad0-ec67-4217-ac4d-7ac7fe030e19 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:30.276362 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:30.323050 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:30.340223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 297/600] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:29:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 20:29:30.341859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f32ae-b985-4f9a-b23e-68b674ffd582 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:30.342846 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f32ae-b985-4f9a-b23e-68b674ffd582 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:30.343328 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f32ae-b985-4f9a-b23e-68b674ffd582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:30.364097 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-397f32ae-b985-4f9a-b23e-68b674ffd582 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:30.365686 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-397f32ae-b985-4f9a-b23e-68b674ffd582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:30.384828 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b5ad0-ec67-4217-ac4d-7ac7fe030e19 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:30.426574 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b8377-2954-49ca-8b5d-26fcffabd815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:30.427185 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b8377-2954-49ca-8b5d-26fcffabd815 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:30.427462 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b8377-2954-49ca-8b5d-26fcffabd815 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:30.427763 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b8377-2954-49ca-8b5d-26fcffabd815 None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:30.428400 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b8377-2954-49ca-8b5d-26fcffabd815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:30.428703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b8377-2954-49ca-8b5d-26fcffabd815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:30.430050 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b8377-2954-49ca-8b5d-26fcffabd815 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:30.438207 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 298/601] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:29:30.442135 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 304/602] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:30.448533 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f32ae-b985-4f9a-b23e-68b674ffd582 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:30.449543 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b8377-2954-49ca-8b5d-26fcffabd815 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:30.542328 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:30.575194 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b8377-2954-49ca-8b5d-26fcffabd815 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:30.577422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f32ae-b985-4f9a-b23e-68b674ffd582 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:30.587775 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:30.614340 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9953a47-b7ec-44b1-9429-e284669676a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:30.614980 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9953a47-b7ec-44b1-9429-e284669676a1 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:30.615370 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9953a47-b7ec-44b1-9429-e284669676a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:30.615685 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9953a47-b7ec-44b1-9429-e284669676a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:30.616512 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317db0c-ce47-428c-913e-f553fb4df377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:30.617863 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317db0c-ce47-428c-913e-f553fb4df377 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:30.618863 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317db0c-ce47-428c-913e-f553fb4df377 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:30.619381 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317db0c-ce47-428c-913e-f553fb4df377 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:30.624427 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9953a47-b7ec-44b1-9429-e284669676a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:30.626426 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9953a47-b7ec-44b1-9429-e284669676a1 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:30.633423 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317db0c-ce47-428c-913e-f553fb4df377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:30.635073 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317db0c-ce47-428c-913e-f553fb4df377 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:30.638903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-c9953a47-b7ec-44b1-9429-e284669676a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:29:30.638903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:30.638903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:30.638903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:30.638903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:30.638903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:30.638903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:30.638903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:30.638903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:30.638903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:30.638903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:30.638903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:30.638903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:29:30.638903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:29:30.638903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:29:30.638903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:29:30.640068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:30.640068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:30.640068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:29:30.640068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:30.640068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:29:30.640068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:30.640068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:30.640068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:30.640068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:30.640068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:30.640068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:30.640068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:30.640068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:30.640068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:30.640068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:30.640068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:30.640068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:30.640068 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:30.641081 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:30.641081 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:30.641081 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:29:30.641081 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:29:30.641081 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:29:30.641081 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:29:30.641081 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:29:30.641081 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:29:30.641081 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:29:30.641081 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:30.643704 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 305/603] 10.222.0.15 () {56 vars in 1093 bytes} [Mon Aug 22 20:29:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:29:30.644768 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9953a47-b7ec-44b1-9429-e284669676a1 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:30.652739 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-d317db0c-ce47-428c-913e-f553fb4df377 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:30.652739 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:30.652739 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:30.652739 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:30.652739 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:30.652739 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:30.652739 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:30.652739 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:30.652739 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:30.652739 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:30.652739 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:30.652739 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:30.652739 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:30.652739 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:30.652739 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:30.652739 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:30.659223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:30.659223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:30.659223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:30.659223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:30.659223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:30.659223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:30.659223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:30.659223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:30.659223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:30.659223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:30.659223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:30.659223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:30.659223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:30.659223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:30.659223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:30.659223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:30.659223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:30.660369 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:30.660369 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:30.660369 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:30.660369 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 299/604] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:30.660660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317db0c-ce47-428c-913e-f553fb4df377 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:30.773195 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9953a47-b7ec-44b1-9429-e284669676a1 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:30.774048 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317db0c-ce47-428c-913e-f553fb4df377 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:30.795486 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:30.809025 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f05ad2-72a1-444a-a9e9-cd6d56f5a6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:30.809456 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817d0b5-136a-45cf-a80e-a8a1899ef06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:30.810913 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f05ad2-72a1-444a-a9e9-cd6d56f5a6e2 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:30.810913 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f05ad2-72a1-444a-a9e9-cd6d56f5a6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:30.811097 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817d0b5-136a-45cf-a80e-a8a1899ef06a None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:30.811250 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f05ad2-72a1-444a-a9e9-cd6d56f5a6e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:30.811364 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817d0b5-136a-45cf-a80e-a8a1899ef06a None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:30.811364 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817d0b5-136a-45cf-a80e-a8a1899ef06a None admin] PATH_INFO: `/v3/users` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:30.811715 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817d0b5-136a-45cf-a80e-a8a1899ef06a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:30.812026 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817d0b5-136a-45cf-a80e-a8a1899ef06a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:30.813486 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817d0b5-136a-45cf-a80e-a8a1899ef06a None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:30.821283 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f05ad2-72a1-444a-a9e9-cd6d56f5a6e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:30.830901 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-94f05ad2-72a1-444a-a9e9-cd6d56f5a6e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:30.830901 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:30.830901 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:30.830901 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:30.830901 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:30.830901 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:30.830901 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:30.830901 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:30.830901 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:30.830901 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:30.830901 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:30.830901 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:30.830901 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:30.830901 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:30.830901 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:30.830901 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:30.834625 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:30.834625 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:30.834625 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:30.834625 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:30.834625 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:30.834625 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:30.834625 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:30.834625 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:30.834625 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:30.834625 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:30.834625 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:30.834625 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:30.834625 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:30.834625 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:30.834625 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:30.834625 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:30.835442 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:30.835442 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:30.835442 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:30.835442 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:30.835442 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:30.835442 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:30.835442 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:30.835442 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:30.835442 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:30.835442 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:30.835442 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:30.835442 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:30.835442 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 306/605] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 20:29:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:30.835442 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f05ad2-72a1-444a-a9e9-cd6d56f5a6e2 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:30.836921 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 300/606] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Aug 22 20:29:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:30.837744 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817d0b5-136a-45cf-a80e-a8a1899ef06a None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:30.866171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:30.937603 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f05ad2-72a1-444a-a9e9-cd6d56f5a6e2 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:30.941144 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817d0b5-136a-45cf-a80e-a8a1899ef06a None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:30.972257 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36204a99-ea66-4194-9171-d46ace1f4cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:30.972858 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36204a99-ea66-4194-9171-d46ace1f4cb6 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:30.973136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36204a99-ea66-4194-9171-d46ace1f4cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:30.973404 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36204a99-ea66-4194-9171-d46ace1f4cb6 None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:30.974039 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36204a99-ea66-4194-9171-d46ace1f4cb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:30.974337 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36204a99-ea66-4194-9171-d46ace1f4cb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:30.975779 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36204a99-ea66-4194-9171-d46ace1f4cb6 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:30.976887 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b582af-5a57-4cf3-a161-d5d8803fe7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:30.977533 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b582af-5a57-4cf3-a161-d5d8803fe7e1 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:30.977814 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b582af-5a57-4cf3-a161-d5d8803fe7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:30.978087 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b582af-5a57-4cf3-a161-d5d8803fe7e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:30.987159 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 307/607] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:30.988007 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36204a99-ea66-4194-9171-d46ace1f4cb6 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:30.988886 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b582af-5a57-4cf3-a161-d5d8803fe7e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:30.993699 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-f2b582af-5a57-4cf3-a161-d5d8803fe7e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:30.993699 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:30.993699 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:30.993699 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:30.993699 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:30.993699 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:30.993699 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:30.993699 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:30.993699 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:30.993699 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:30.993699 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:30.993699 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:30.993699 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:30.993699 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:30.993699 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:30.993699 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:30.994623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:30.994623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:30.994623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:30.994623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:30.994623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:30.994623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:30.994623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:30.994623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:30.994623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:30.994623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:30.994623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:30.994623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:30.994623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:30.994623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:30.994623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:30.994623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:30.995473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:30.995473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:30.995473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:30.995473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:30.995473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:30.995473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:30.995473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:30.995473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:30.995473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:30.995473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:30.995473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:30.995473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:30.995473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 301/608] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 20:29:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:30.996610 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b582af-5a57-4cf3-a161-d5d8803fe7e1 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:31.040808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:31.075282 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:31.087794 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36204a99-ea66-4194-9171-d46ace1f4cb6 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:31.101545 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b582af-5a57-4cf3-a161-d5d8803fe7e1 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:31.127148 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24b6c4-73b2-40f0-8580-ea1bcf638501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:31.127787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24b6c4-73b2-40f0-8580-ea1bcf638501 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:31.128074 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24b6c4-73b2-40f0-8580-ea1bcf638501 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:31.128349 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24b6c4-73b2-40f0-8580-ea1bcf638501 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:31.137271 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df64441-5d8b-40fd-89e6-53e1bbaed874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:31.137869 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df64441-5d8b-40fd-89e6-53e1bbaed874 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:31.138153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df64441-5d8b-40fd-89e6-53e1bbaed874 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:31.138423 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df64441-5d8b-40fd-89e6-53e1bbaed874 None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:31.139704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df64441-5d8b-40fd-89e6-53e1bbaed874 None admin] RBAC: Adding query filter params (name=service) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:31.140019 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df64441-5d8b-40fd-89e6-53e1bbaed874 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:31.141447 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df64441-5d8b-40fd-89e6-53e1bbaed874 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:31.154713 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 302/609] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 20:29:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:31.154713 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df64441-5d8b-40fd-89e6-53e1bbaed874 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:31.200108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24b6c4-73b2-40f0-8580-ea1bcf638501 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:31.201616 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24b6c4-73b2-40f0-8580-ea1bcf638501 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:31.261419 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:31.264871 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df64441-5d8b-40fd-89e6-53e1bbaed874 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:31.291719 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:31.299017 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb223f-5252-4ecc-b6cc-e49f5591b6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:31.299680 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb223f-5252-4ecc-b6cc-e49f5591b6f9 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:31.299965 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb223f-5252-4ecc-b6cc-e49f5591b6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:31.300242 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb223f-5252-4ecc-b6cc-e49f5591b6f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:31.305319 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 308/610] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:29:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:29:31.306161 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24b6c4-73b2-40f0-8580-ea1bcf638501 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:31.307096 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb223f-5252-4ecc-b6cc-e49f5591b6f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:31.308658 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb223f-5252-4ecc-b6cc-e49f5591b6f9 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:31.323247 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-c3cb223f-5252-4ecc-b6cc-e49f5591b6f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:31.323247 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:31.323247 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:31.323247 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:31.323247 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:31.323247 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:31.323247 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:31.323247 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:31.323247 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:31.323247 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:31.323247 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:31.323247 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:31.323247 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:29:31.323247 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:29:31.323247 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:29:31.331576 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:29:31.331576 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:31.331576 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:31.331576 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:31.331576 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:31.331576 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:31.331576 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:31.331576 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:31.331576 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:31.331576 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:31.331576 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:31.331576 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:31.331576 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:31.331576 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:31.331576 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:31.331576 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:31.331576 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:31.332473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:29:31.332473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:29:31.332473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:29:31.332473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:29:31.332473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:29:31.332473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:29:31.332473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:31.332473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:31.332473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 303/611] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:31.332473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb223f-5252-4ecc-b6cc-e49f5591b6f9 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:31.411566 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24b6c4-73b2-40f0-8580-ea1bcf638501 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:31.432352 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb223f-5252-4ecc-b6cc-e49f5591b6f9 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:31.446939 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00019d99-b170-4b67-83a7-0f974717c130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:31.447555 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00019d99-b170-4b67-83a7-0f974717c130 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:31.448270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00019d99-b170-4b67-83a7-0f974717c130 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:31.448270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00019d99-b170-4b67-83a7-0f974717c130 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:31.448952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00019d99-b170-4b67-83a7-0f974717c130 None admin] RBAC: Adding query filter params (name=service) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:31.449207 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00019d99-b170-4b67-83a7-0f974717c130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:31.450581 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00019d99-b170-4b67-83a7-0f974717c130 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:31.459284 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 309/612] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 20:29:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:31.460146 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00019d99-b170-4b67-83a7-0f974717c130 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:31.473305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2f9b4-72de-4a8b-bd5c-23160beef0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:31.473981 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2f9b4-72de-4a8b-bd5c-23160beef0f7 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:31.474262 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2f9b4-72de-4a8b-bd5c-23160beef0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:31.474536 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2f9b4-72de-4a8b-bd5c-23160beef0f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:31.486152 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2f9b4-72de-4a8b-bd5c-23160beef0f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:31.487650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2f9b4-72de-4a8b-bd5c-23160beef0f7 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:31.504153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-e2d2f9b4-72de-4a8b-bd5c-23160beef0f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:31.504153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:31.504153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:31.504153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:31.504153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:31.504153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:31.504153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:31.504153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:31.504153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:31.504153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:31.504153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:31.504153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:31.504153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:31.504153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:31.504153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:31.504153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:31.505311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:31.505311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:31.505311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:31.505311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:31.505311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:31.505311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:31.505311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:31.505311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:31.505311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:31.505311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:31.505311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:31.505311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:31.505311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:31.505311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:31.505311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:31.505311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:31.505311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:31.506725 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:31.506725 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:31.506725 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:31.506725 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 304/613] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:31.506725 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2f9b4-72de-4a8b-bd5c-23160beef0f7 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:31.514380 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:31.522431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:31.571062 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00019d99-b170-4b67-83a7-0f974717c130 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:31.604772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b623629-6e43-4443-b59a-2a2eab91ecd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:31.605312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b623629-6e43-4443-b59a-2a2eab91ecd5 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:31.605587 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b623629-6e43-4443-b59a-2a2eab91ecd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:31.605861 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b623629-6e43-4443-b59a-2a2eab91ecd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:31.613407 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2f9b4-72de-4a8b-bd5c-23160beef0f7 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:31.617121 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b623629-6e43-4443-b59a-2a2eab91ecd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:31.618603 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b623629-6e43-4443-b59a-2a2eab91ecd5 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:31.633527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-1b623629-6e43-4443-b59a-2a2eab91ecd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:31.633527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:31.633527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:31.633527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:31.633527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:31.633527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:31.633527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:31.633527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:31.633527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:31.633527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:31.633527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:31.633527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:31.633527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:31.633527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:31.633527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:31.633527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:31.634615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:31.634615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:31.634615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:31.634615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:31.634615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:31.634615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:31.634615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:31.634615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:31.634615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:31.634615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:31.634615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:31.634615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:31.634615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:31.634615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:31.634615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:31.634615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:31.634615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:31.635496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:31.635496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:31.635496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:31.635496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 310/614] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:31.635496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b623629-6e43-4443-b59a-2a2eab91ecd5 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:31.650698 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85015cb2-73af-455a-a52b-ebb8bc2cb4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:31.651406 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85015cb2-73af-455a-a52b-ebb8bc2cb4ab None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:31.651781 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85015cb2-73af-455a-a52b-ebb8bc2cb4ab None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:31.652066 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85015cb2-73af-455a-a52b-ebb8bc2cb4ab None admin] PATH_INFO: `/v3/projects` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:31.652817 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85015cb2-73af-455a-a52b-ebb8bc2cb4ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:31.653123 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85015cb2-73af-455a-a52b-ebb8bc2cb4ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:31.654679 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85015cb2-73af-455a-a52b-ebb8bc2cb4ab None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:31.666404 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 305/615] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 20:29:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:31.667237 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85015cb2-73af-455a-a52b-ebb8bc2cb4ab None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:31.741815 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:31.748116 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b623629-6e43-4443-b59a-2a2eab91ecd5 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:31.749713 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:31.772495 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85015cb2-73af-455a-a52b-ebb8bc2cb4ab None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:31.785168 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f77d3-ea99-4a5a-ad93-7430eb1ced29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:31.785804 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f77d3-ea99-4a5a-ad93-7430eb1ced29 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:31.786151 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f77d3-ea99-4a5a-ad93-7430eb1ced29 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:31.786410 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f77d3-ea99-4a5a-ad93-7430eb1ced29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:31.796613 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f77d3-ea99-4a5a-ad93-7430eb1ced29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:31.798060 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f77d3-ea99-4a5a-ad93-7430eb1ced29 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:31.808204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bce87-8ec4-4bb2-afb9-27c9f20160dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:31.808809 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bce87-8ec4-4bb2-afb9-27c9f20160dc None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:31.809084 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bce87-8ec4-4bb2-afb9-27c9f20160dc None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:31.809353 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bce87-8ec4-4bb2-afb9-27c9f20160dc None admin] PATH_INFO: `/v3/domains` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:31.809989 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bce87-8ec4-4bb2-afb9-27c9f20160dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:31.810291 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bce87-8ec4-4bb2-afb9-27c9f20160dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:31.811965 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bce87-8ec4-4bb2-afb9-27c9f20160dc None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:31.812899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-6f7f77d3-ea99-4a5a-ad93-7430eb1ced29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:31.812899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:31.812899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:31.812899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:31.812899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:31.812899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:31.812899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:31.812899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:31.812899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:31.812899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:31.812899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:31.812899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:31.812899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:31.812899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:31.812899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:31.812899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:31.813933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:31.813933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:31.813933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:31.813933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:31.813933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:31.813933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:31.813933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:31.813933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:31.813933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:31.813933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:31.813933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:31.813933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:31.813933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:31.813933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:31.813933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:31.813933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:31.813933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:31.814867 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:31.814867 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:31.814867 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:31.814867 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 311/616] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:31.814867 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f77d3-ea99-4a5a-ad93-7430eb1ced29 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:31.830367 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 306/617] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:31.831311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bce87-8ec4-4bb2-afb9-27c9f20160dc None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:31.918002 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f77d3-ea99-4a5a-ad93-7430eb1ced29 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:31.936720 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bce87-8ec4-4bb2-afb9-27c9f20160dc None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:31.952971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d0642-32e8-4b1b-8580-1f143e75fd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:31.953650 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d0642-32e8-4b1b-8580-1f143e75fd67 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:31.953874 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d0642-32e8-4b1b-8580-1f143e75fd67 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:31.954158 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d0642-32e8-4b1b-8580-1f143e75fd67 None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:31.954801 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d0642-32e8-4b1b-8580-1f143e75fd67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:31.955108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d0642-32e8-4b1b-8580-1f143e75fd67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:31.956521 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d0642-32e8-4b1b-8580-1f143e75fd67 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:31.967410 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:31.968968 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 312/618] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:31.969810 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d0642-32e8-4b1b-8580-1f143e75fd67 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:31.972678 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3335d1-cc24-4f86-877d-603675814991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:31.973293 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3335d1-cc24-4f86-877d-603675814991 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:31.973575 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3335d1-cc24-4f86-877d-603675814991 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:31.973849 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3335d1-cc24-4f86-877d-603675814991 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:31.974817 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3335d1-cc24-4f86-877d-603675814991 None admin] RBAC: Adding query filter params (role.id=b92ee6686fe5412f9b7fdf27fb4c21d3, scope.project.id=7bda5c44ace24608b8ca69e9059d73ef, user.id=d0b7833b75334bceb549f7184041aacc) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:31.975135 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3335d1-cc24-4f86-877d-603675814991 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:31.976622 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3335d1-cc24-4f86-877d-603675814991 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:31.983520 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 307/619] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:29:31 2022] GET /identity/v3/role_assignments?user.id=d0b7833b75334bceb549f7184041aacc&scope.project.id=7bda5c44ace24608b8ca69e9059d73ef&role.id=b92ee6686fe5412f9b7fdf27fb4c21d3 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:31.984436 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3335d1-cc24-4f86-877d-603675814991 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:31.995142 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:32.104120 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d0642-32e8-4b1b-8580-1f143e75fd67 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:32.112806 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3335d1-cc24-4f86-877d-603675814991 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:32.150088 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f867eaa-2721-4ac2-ba8a-06ce487829dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:32.150728 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f867eaa-2721-4ac2-ba8a-06ce487829dc None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:32.151018 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f867eaa-2721-4ac2-ba8a-06ce487829dc None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:32.151295 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f867eaa-2721-4ac2-ba8a-06ce487829dc None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:32.152029 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f867eaa-2721-4ac2-ba8a-06ce487829dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:32.152341 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f867eaa-2721-4ac2-ba8a-06ce487829dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:32.153798 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f867eaa-2721-4ac2-ba8a-06ce487829dc None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:32.159369 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc70c5-f66a-4801-9326-49ea5d35a257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:32.160569 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc70c5-f66a-4801-9326-49ea5d35a257 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:32.160569 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc70c5-f66a-4801-9326-49ea5d35a257 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:32.160825 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc70c5-f66a-4801-9326-49ea5d35a257 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:32.171790 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 313/620] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:32.171790 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f867eaa-2721-4ac2-ba8a-06ce487829dc None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:32.172417 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc70c5-f66a-4801-9326-49ea5d35a257 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:32.172417 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc70c5-f66a-4801-9326-49ea5d35a257 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:32.186376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-03cc70c5-f66a-4801-9326-49ea5d35a257 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 20:29:32.186376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:32.186376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:32.186376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:32.186376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:32.186376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:32.186376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:32.186376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:32.186376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:32.186376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:32.186376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:32.186376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:32.186376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:29:32.186376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:29:32.186376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:29:32.186376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:29:32.194467 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:32.194467 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:32.194467 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:29:32.194467 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:32.194467 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:29:32.194467 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:32.194467 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:32.194467 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:32.194467 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:32.194467 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:32.194467 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:32.194467 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:32.194467 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:32.194467 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:32.194467 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:32.194467 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:32.194467 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:32.194467 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:32.195629 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:32.195629 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:32.195629 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:29:32.195629 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:29:32.195629 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:29:32.195629 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:29:32.195629 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:29:32.195629 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:29:32.195629 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 20:29:32.195629 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:32.195629 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 308/621] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:29:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:32.195629 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc70c5-f66a-4801-9326-49ea5d35a257 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:32.262021 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:32.274544 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:32.300153 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f867eaa-2721-4ac2-ba8a-06ce487829dc None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:32.314816 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc70c5-f66a-4801-9326-49ea5d35a257 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:32.341073 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15d346-39ce-48a0-855d-d652cf38d39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:32.341866 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15d346-39ce-48a0-855d-d652cf38d39f None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:32.342324 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15d346-39ce-48a0-855d-d652cf38d39f None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:32.342934 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15d346-39ce-48a0-855d-d652cf38d39f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:32.350292 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ad733-b1d2-4d80-bf2d-487887b69d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:32.350929 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ad733-b1d2-4d80-bf2d-487887b69d8e None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:32.351213 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ad733-b1d2-4d80-bf2d-487887b69d8e None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:32.351310 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15d346-39ce-48a0-855d-d652cf38d39f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:32.351491 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ad733-b1d2-4d80-bf2d-487887b69d8e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:32.352775 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15d346-39ce-48a0-855d-d652cf38d39f None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:32.360125 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ad733-b1d2-4d80-bf2d-487887b69d8e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:32.361653 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ad733-b1d2-4d80-bf2d-487887b69d8e None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:32.366731 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-ec15d346-39ce-48a0-855d-d652cf38d39f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:32.366731 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:32.366731 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:32.366731 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:32.366731 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:32.366731 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:32.366731 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:32.366731 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:32.366731 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:32.366731 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:32.366731 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:32.366731 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:32.366731 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:29:32.366731 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:29:32.366731 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:29:32.367925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:29:32.367925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:32.367925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:32.367925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:32.367925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:32.367925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:32.367925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:32.367925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:32.367925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:32.367925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:32.367925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:32.367925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:32.367925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:32.367925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:32.367925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:32.367925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:32.367925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:32.368848 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:29:32.368848 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:29:32.368848 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:29:32.368848 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:29:32.368848 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:29:32.368848 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:29:32.368848 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:32.368848 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:32.371699 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 314/622] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:32.372617 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15d346-39ce-48a0-855d-d652cf38d39f None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:32.378954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-6f4ad733-b1d2-4d80-bf2d-487887b69d8e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 20:29:32.378954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:32.378954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:32.378954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:32.378954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:32.378954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:32.378954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:32.378954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:32.378954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:32.378954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:32.378954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:32.378954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:32.378954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:29:32.378954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:29:32.378954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:29:32.378954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:29:32.379918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:32.379918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:32.379918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:29:32.379918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:32.379918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:29:32.379918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:32.379918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:32.379918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:32.379918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:32.379918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:32.379918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:32.379918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:32.379918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:32.379918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:32.379918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:32.379918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:32.379918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:32.379918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:32.386281 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:32.386281 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:32.386281 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:29:32.386281 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:29:32.386281 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:29:32.386281 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:29:32.386281 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:29:32.386281 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:29:32.386281 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 20:29:32.386281 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:32.386281 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 309/623] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 20:29:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:32.386281 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ad733-b1d2-4d80-bf2d-487887b69d8e None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:32.487215 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15d346-39ce-48a0-855d-d652cf38d39f None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:32.494500 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ad733-b1d2-4d80-bf2d-487887b69d8e None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:32.511741 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:32.527793 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d60cb-4c5f-4316-ba73-7d32a4ee4cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:32.528415 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d60cb-4c5f-4316-ba73-7d32a4ee4cb6 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:32.528701 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d60cb-4c5f-4316-ba73-7d32a4ee4cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:32.528976 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d60cb-4c5f-4316-ba73-7d32a4ee4cb6 None admin] PATH_INFO: `/v3/users` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:32.530268 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d60cb-4c5f-4316-ba73-7d32a4ee4cb6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:32.530583 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d60cb-4c5f-4316-ba73-7d32a4ee4cb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:32.532599 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d60cb-4c5f-4316-ba73-7d32a4ee4cb6 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:32.536582 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:32.538828 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198a39d-b544-411a-92fe-6befa901b170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:32.539439 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198a39d-b544-411a-92fe-6befa901b170 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:32.539745 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198a39d-b544-411a-92fe-6befa901b170 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:32.540019 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198a39d-b544-411a-92fe-6befa901b170 None admin] PATH_INFO: `/v3/projects` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:32.540714 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198a39d-b544-411a-92fe-6befa901b170 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:32.541016 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198a39d-b544-411a-92fe-6befa901b170 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:32.542442 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198a39d-b544-411a-92fe-6befa901b170 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:32.553111 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 315/624] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Aug 22 20:29:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:32.553688 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d60cb-4c5f-4316-ba73-7d32a4ee4cb6 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:32.557450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 310/625] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 20:29:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:32.558475 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198a39d-b544-411a-92fe-6befa901b170 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:32.667277 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d60cb-4c5f-4316-ba73-7d32a4ee4cb6 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:32.671638 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198a39d-b544-411a-92fe-6befa901b170 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:32.704452 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d2ff0-8a9e-49d7-b909-a4c0afbf522e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:32.705072 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d2ff0-8a9e-49d7-b909-a4c0afbf522e None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:32.705355 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d2ff0-8a9e-49d7-b909-a4c0afbf522e None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:32.705630 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d2ff0-8a9e-49d7-b909-a4c0afbf522e None admin] PATH_INFO: `/v3/users` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:32.706360 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d2ff0-8a9e-49d7-b909-a4c0afbf522e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:32.706669 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d2ff0-8a9e-49d7-b909-a4c0afbf522e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:32.708140 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d2ff0-8a9e-49d7-b909-a4c0afbf522e None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:32.711699 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b81623-d9ad-4488-b385-bf1dd34292ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:32.712589 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b81623-d9ad-4488-b385-bf1dd34292ef None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:32.713054 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b81623-d9ad-4488-b385-bf1dd34292ef None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:32.713511 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b81623-d9ad-4488-b385-bf1dd34292ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:32.726403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 316/626] 10.222.0.15 () {56 vars in 1139 bytes} [Mon Aug 22 20:29:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:32.727846 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d2ff0-8a9e-49d7-b909-a4c0afbf522e None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:32.770319 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:32.784766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:32.793994 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b81623-d9ad-4488-b385-bf1dd34292ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:32.795482 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b81623-d9ad-4488-b385-bf1dd34292ef None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:32.834861 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d2ff0-8a9e-49d7-b909-a4c0afbf522e None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:32.869567 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790acab8-30a7-46a9-bedd-66b8e04b2ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:32.870318 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790acab8-30a7-46a9-bedd-66b8e04b2ea1 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:32.871080 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790acab8-30a7-46a9-bedd-66b8e04b2ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:32.871362 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790acab8-30a7-46a9-bedd-66b8e04b2ea1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:32.872160 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790acab8-30a7-46a9-bedd-66b8e04b2ea1 None admin] RBAC: Adding query filter params (role.id=b92ee6686fe5412f9b7fdf27fb4c21d3, scope.project.id=7bda5c44ace24608b8ca69e9059d73ef, user.id=c18d1768fb7a4bac93b28d095b74caf6) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:32.872717 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790acab8-30a7-46a9-bedd-66b8e04b2ea1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:32.875180 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790acab8-30a7-46a9-bedd-66b8e04b2ea1 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:32.891582 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 317/627] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:29:32 2022] GET /identity/v3/role_assignments?user.id=c18d1768fb7a4bac93b28d095b74caf6&scope.project.id=7bda5c44ace24608b8ca69e9059d73ef&role.id=b92ee6686fe5412f9b7fdf27fb4c21d3 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:32.891582 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790acab8-30a7-46a9-bedd-66b8e04b2ea1 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:32.921074 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 311/628] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:29:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:29:32.922239 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b81623-d9ad-4488-b385-bf1dd34292ef None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:33.020710 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:33.027218 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790acab8-30a7-46a9-bedd-66b8e04b2ea1 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:33.047648 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:33.049638 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b81623-d9ad-4488-b385-bf1dd34292ef None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:33.075776 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb16b3-3a0a-498f-8910-aa9ae99e5f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:33.076553 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb16b3-3a0a-498f-8910-aa9ae99e5f01 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:33.077085 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb16b3-3a0a-498f-8910-aa9ae99e5f01 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:33.077519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb16b3-3a0a-498f-8910-aa9ae99e5f01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:33.091338 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58419c5b-09b7-42f0-b93a-e80476d3531e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:33.092433 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58419c5b-09b7-42f0-b93a-e80476d3531e None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:33.092929 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58419c5b-09b7-42f0-b93a-e80476d3531e None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:33.093434 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58419c5b-09b7-42f0-b93a-e80476d3531e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:33.108441 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58419c5b-09b7-42f0-b93a-e80476d3531e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:33.110461 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58419c5b-09b7-42f0-b93a-e80476d3531e None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:33.130190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-58419c5b-09b7-42f0-b93a-e80476d3531e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:33.130190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:33.130190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:33.130190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:33.130190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:33.130190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:33.130190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:33.130190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:33.130190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:33.130190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:33.130190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:33.130190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:33.130190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:33.130190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:33.130190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:33.130190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:33.131256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:33.131256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:33.131256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:33.131256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:33.131256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:33.131256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:33.131256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:33.131256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:33.131256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:33.131256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:33.131256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:33.131256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:33.131256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:33.131256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:33.131256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:33.131256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:33.131256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:33.132287 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:33.132287 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:33.132287 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:33.139394 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 312/629] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:33.141011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58419c5b-09b7-42f0-b93a-e80476d3531e None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:33.171899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb16b3-3a0a-498f-8910-aa9ae99e5f01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:33.173830 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb16b3-3a0a-498f-8910-aa9ae99e5f01 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:33.267657 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58419c5b-09b7-42f0-b93a-e80476d3531e None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:33.302362 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:33.303331 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 318/630] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:29:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:29:33.308785 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb16b3-3a0a-498f-8910-aa9ae99e5f01 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:33.312810 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcf148-2c51-4767-863c-f536e1a21f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:33.313711 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcf148-2c51-4767-863c-f536e1a21f96 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:33.314194 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcf148-2c51-4767-863c-f536e1a21f96 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:33.314670 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcf148-2c51-4767-863c-f536e1a21f96 None admin] PATH_INFO: `/v3/domains` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:33.315577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdcf148-2c51-4767-863c-f536e1a21f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:33.320070 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdcf148-2c51-4767-863c-f536e1a21f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:33.320070 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdcf148-2c51-4767-863c-f536e1a21f96 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:33.324610 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:33.336460 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 313/631] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:33.337764 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcf148-2c51-4767-863c-f536e1a21f96 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:33.428639 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb16b3-3a0a-498f-8910-aa9ae99e5f01 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:33.455368 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcf148-2c51-4767-863c-f536e1a21f96 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:33.465057 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26efd7e-4659-46eb-920d-8efc3073af54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:33.465755 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26efd7e-4659-46eb-920d-8efc3073af54 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:33.466036 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26efd7e-4659-46eb-920d-8efc3073af54 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:33.466416 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26efd7e-4659-46eb-920d-8efc3073af54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:33.477826 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26efd7e-4659-46eb-920d-8efc3073af54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:33.479330 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26efd7e-4659-46eb-920d-8efc3073af54 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:33.495487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-f26efd7e-4659-46eb-920d-8efc3073af54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:33.495487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:33.495487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:33.495487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:33.495487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:33.495487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:33.495487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:33.495487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:33.495487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:33.495487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:33.495487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:33.495487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:33.495487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:33.495487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:33.495487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:33.495487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:33.496486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:33.496486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:33.496486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:33.496486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:33.496486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:33.496486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:33.496486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:33.496486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:33.496486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:33.496486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:33.496486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:33.496486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:33.496486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:33.496486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:33.496486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:33.496486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:33.496486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:33.497351 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:33.497351 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:33.497351 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:33.497516 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc176f-38b2-4641-b87f-a55791fd7779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:33.497516 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc176f-38b2-4641-b87f-a55791fd7779 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:33.498116 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc176f-38b2-4641-b87f-a55791fd7779 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:33.498116 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc176f-38b2-4641-b87f-a55791fd7779 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:33.503568 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 319/632] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:29:33.504546 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26efd7e-4659-46eb-920d-8efc3073af54 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:33.505640 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc176f-38b2-4641-b87f-a55791fd7779 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:33.507158 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc176f-38b2-4641-b87f-a55791fd7779 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:33.519248 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-15cc176f-38b2-4641-b87f-a55791fd7779 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:33.519248 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:33.519248 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:33.519248 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:33.519248 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:33.519248 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:33.519248 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:33.519248 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:33.519248 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:33.519248 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:33.519248 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:33.519248 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:33.519248 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:29:33.519248 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:29:33.519248 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:29:33.521397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:29:33.521397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:33.521397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:33.521397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:33.521397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:33.521397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:33.521397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:33.521397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:33.521397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:33.521397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:33.521397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:33.521397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:33.521397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:33.521397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:33.521397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:33.521397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:33.521397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:33.523502 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:29:33.523502 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:29:33.523502 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:29:33.523502 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:29:33.523502 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:29:33.523502 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:29:33.523502 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:33.523502 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:33.531571 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 314/633] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:29:33.531571 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc176f-38b2-4641-b87f-a55791fd7779 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:33.577751 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:33.582169 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:33.616835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26efd7e-4659-46eb-920d-8efc3073af54 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:33.637659 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc176f-38b2-4641-b87f-a55791fd7779 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:33.653264 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edc82e-f0b6-48e1-81e8-b8fa9303df3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:33.653879 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edc82e-f0b6-48e1-81e8-b8fa9303df3f None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:33.654160 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edc82e-f0b6-48e1-81e8-b8fa9303df3f None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:33.654430 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edc82e-f0b6-48e1-81e8-b8fa9303df3f None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:33.655720 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edc82e-f0b6-48e1-81e8-b8fa9303df3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:33.656079 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edc82e-f0b6-48e1-81e8-b8fa9303df3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:33.657417 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edc82e-f0b6-48e1-81e8-b8fa9303df3f None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:33.675260 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 320/634] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:33.676297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edc82e-f0b6-48e1-81e8-b8fa9303df3f None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:33.678319 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c823f-40e2-4ff5-bf71-be978d594955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:33.679576 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c823f-40e2-4ff5-bf71-be978d594955 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:33.680104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c823f-40e2-4ff5-bf71-be978d594955 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:33.680547 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c823f-40e2-4ff5-bf71-be978d594955 None admin] PATH_INFO: `/v3/projects` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:33.681397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c823f-40e2-4ff5-bf71-be978d594955 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:33.681865 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c823f-40e2-4ff5-bf71-be978d594955 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:33.683481 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c823f-40e2-4ff5-bf71-be978d594955 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:33.697914 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 315/635] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 20:29:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:33.706634 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c823f-40e2-4ff5-bf71-be978d594955 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:33.791383 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edc82e-f0b6-48e1-81e8-b8fa9303df3f None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:33.817612 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c823f-40e2-4ff5-bf71-be978d594955 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:33.821200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:33.834916 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:33.835103 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359460f-70cb-43f2-8910-8345295675cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:33.835103 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359460f-70cb-43f2-8910-8345295675cc None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:33.835103 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359460f-70cb-43f2-8910-8345295675cc None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:33.835103 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359460f-70cb-43f2-8910-8345295675cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:33.841923 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359460f-70cb-43f2-8910-8345295675cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:33.844304 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359460f-70cb-43f2-8910-8345295675cc None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:33.857097 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-5359460f-70cb-43f2-8910-8345295675cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:33.857097 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:33.857097 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:33.857097 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:33.857097 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:33.857097 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:33.857097 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:33.857097 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:33.857097 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:33.857097 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:33.857097 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:33.857097 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:33.857097 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:29:33.857097 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:29:33.857097 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:29:33.858126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:29:33.858126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:33.858126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:33.858126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:33.858126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:33.858126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:33.858126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:33.858126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:33.858126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:33.858126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:33.858126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:33.858126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:33.858126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:33.858126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:33.858126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:33.858126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:33.858126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:33.859009 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:29:33.859009 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:29:33.859009 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:29:33.859009 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:29:33.859009 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:29:33.859009 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:29:33.859009 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:33.859009 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:33.859009 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 321/636] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:33.864409 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359460f-70cb-43f2-8910-8345295675cc None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:33.872656 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a9813-9afc-4f1b-ae2a-4ad4964b7742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:33.872656 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a9813-9afc-4f1b-ae2a-4ad4964b7742 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:33.872656 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a9813-9afc-4f1b-ae2a-4ad4964b7742 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:33.872656 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a9813-9afc-4f1b-ae2a-4ad4964b7742 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:33.873915 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a9813-9afc-4f1b-ae2a-4ad4964b7742 None admin] RBAC: Adding query filter params (role.id=b92ee6686fe5412f9b7fdf27fb4c21d3, scope.project.id=7bda5c44ace24608b8ca69e9059d73ef, user.id=dcac07ea52e44b7cb7df360dbec74254) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:33.874436 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a9813-9afc-4f1b-ae2a-4ad4964b7742 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:33.876332 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a9813-9afc-4f1b-ae2a-4ad4964b7742 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:33.883671 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 316/637] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:29:33 2022] GET /identity/v3/role_assignments?user.id=dcac07ea52e44b7cb7df360dbec74254&scope.project.id=7bda5c44ace24608b8ca69e9059d73ef&role.id=b92ee6686fe5412f9b7fdf27fb4c21d3 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:33.979842 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359460f-70cb-43f2-8910-8345295675cc None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:34.018738 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256e312-4397-4da8-8582-6677c9935775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:34.019382 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256e312-4397-4da8-8582-6677c9935775 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:34.019703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256e312-4397-4da8-8582-6677c9935775 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:34.019985 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256e312-4397-4da8-8582-6677c9935775 None admin] PATH_INFO: `/v3/projects` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:34.020724 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256e312-4397-4da8-8582-6677c9935775 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:34.021041 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256e312-4397-4da8-8582-6677c9935775 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:34.022577 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256e312-4397-4da8-8582-6677c9935775 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:34.037591 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 322/638] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 20:29:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:34.044288 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a9813-9afc-4f1b-ae2a-4ad4964b7742 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:34.164961 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a9813-9afc-4f1b-ae2a-4ad4964b7742 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:34.204135 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153edca-ead8-4cf7-aa45-5078ef662475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:34.205184 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153edca-ead8-4cf7-aa45-5078ef662475 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:34.205668 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153edca-ead8-4cf7-aa45-5078ef662475 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:34.206154 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153edca-ead8-4cf7-aa45-5078ef662475 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:34.207174 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153edca-ead8-4cf7-aa45-5078ef662475 None admin] RBAC: Adding query filter params (role.id=b92ee6686fe5412f9b7fdf27fb4c21d3, scope.project.id=7bda5c44ace24608b8ca69e9059d73ef, user.id=340a791917d14686bb14e13544c1ce9b) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:34.207730 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153edca-ead8-4cf7-aa45-5078ef662475 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:34.209417 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153edca-ead8-4cf7-aa45-5078ef662475 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:34.216747 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 317/639] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:29:34 2022] GET /identity/v3/role_assignments?user.id=340a791917d14686bb14e13544c1ce9b&scope.project.id=7bda5c44ace24608b8ca69e9059d73ef&role.id=b92ee6686fe5412f9b7fdf27fb4c21d3 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:34.321485 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea4cd1-657d-4b2e-99ee-584d14203cbe None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:34.321821 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea4cd1-657d-4b2e-99ee-584d14203cbe None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:34.322041 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea4cd1-657d-4b2e-99ee-584d14203cbe None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:34.323746 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 323/640] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:34.330082 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354064b-9365-47cb-b939-120e0ff9c51b None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:34.330346 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354064b-9365-47cb-b939-120e0ff9c51b None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:34.330619 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354064b-9365-47cb-b939-120e0ff9c51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:34.350827 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-a354064b-9365-47cb-b939-120e0ff9c51b None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:34.352086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-a354064b-9365-47cb-b939-120e0ff9c51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:34.388157 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:34.431286 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 318/641] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:29:34.766720 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea4cd1-657d-4b2e-99ee-584d14203cbe None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:34.825046 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:34.883703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea4cd1-657d-4b2e-99ee-584d14203cbe None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:34.921864 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52601d-9ba4-424f-a434-463540a5edf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:34.922509 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52601d-9ba4-424f-a434-463540a5edf2 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:34.922793 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52601d-9ba4-424f-a434-463540a5edf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:34.923070 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52601d-9ba4-424f-a434-463540a5edf2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:34.923693 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52601d-9ba4-424f-a434-463540a5edf2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:34.925084 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52601d-9ba4-424f-a434-463540a5edf2 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:34.936535 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-7f52601d-9ba4-424f-a434-463540a5edf2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:29:34.936535 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:34.936535 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:29:34.936535 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:29:34.936535 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:29:34.936535 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:29:34.936535 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:29:34.936535 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:34.936535 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:29:34.936535 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:34.936535 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:29:34.936535 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:34.936535 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:34.936535 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:34.936535 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:34.936535 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:34.936535 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:34.937618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:34.937618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:34.937618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:34.937618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:34.937618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:34.937618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:34.937618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:29:34.937618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:29:34.937618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:29:34.937618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:29:34.937618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:34.937618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:34.937618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:34.937618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:34.937618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:34.937618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:34.938558 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:34.938558 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:34.938558 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:34.938558 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:34.938558 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:34.938558 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:34.938558 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:34.938558 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:34.938558 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:34.938558 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:34.938558 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:29:34.938558 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:34.938558 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:29:34.938558 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:34.938558 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 324/642] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Aug 22 20:29:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:34.944573 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354064b-9365-47cb-b939-120e0ff9c51b None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:35.056829 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354064b-9365-47cb-b939-120e0ff9c51b None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:35.093832 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6761e4-3296-4b1b-981f-61a7b905a525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:35.094836 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6761e4-3296-4b1b-981f-61a7b905a525 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:35.095319 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6761e4-3296-4b1b-981f-61a7b905a525 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:35.095823 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6761e4-3296-4b1b-981f-61a7b905a525 None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:35.096661 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6761e4-3296-4b1b-981f-61a7b905a525 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:35.097173 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6761e4-3296-4b1b-981f-61a7b905a525 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:35.098739 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6761e4-3296-4b1b-981f-61a7b905a525 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:35.104149 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 319/643] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Aug 22 20:29:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:35.110212 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52601d-9ba4-424f-a434-463540a5edf2 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:35.233281 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52601d-9ba4-424f-a434-463540a5edf2 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:35.245458 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:35.273865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73d6e1-a24f-4506-94d5-88330bc20a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:35.274495 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73d6e1-a24f-4506-94d5-88330bc20a69 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:35.274779 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73d6e1-a24f-4506-94d5-88330bc20a69 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:35.275056 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73d6e1-a24f-4506-94d5-88330bc20a69 None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:35.275848 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73d6e1-a24f-4506-94d5-88330bc20a69 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:35.276073 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73d6e1-a24f-4506-94d5-88330bc20a69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:35.277535 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73d6e1-a24f-4506-94d5-88330bc20a69 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:35.285278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 325/644] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Aug 22 20:29:35 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:35.443342 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7735334-c9c6-41a5-ba15-837e9322f757 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:35.444015 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7735334-c9c6-41a5-ba15-837e9322f757 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:35.444518 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7735334-c9c6-41a5-ba15-837e9322f757 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:35.446403 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 320/645] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:35.453019 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee80db-1f1d-4a04-a6a2-ec8dff64e92c None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:35.453672 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee80db-1f1d-4a04-a6a2-ec8dff64e92c None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:35.454164 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee80db-1f1d-4a04-a6a2-ec8dff64e92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:35.474392 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-9dee80db-1f1d-4a04-a6a2-ec8dff64e92c None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:35.475656 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-9dee80db-1f1d-4a04-a6a2-ec8dff64e92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:35.553717 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 326/646] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:29:35.895135 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7735334-c9c6-41a5-ba15-837e9322f757 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:35.929582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:36.009437 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7735334-c9c6-41a5-ba15-837e9322f757 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:36.046678 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701aa960-a43f-4703-8639-b7931a510ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:36.047722 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701aa960-a43f-4703-8639-b7931a510ced None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:36.048210 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701aa960-a43f-4703-8639-b7931a510ced None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:36.048687 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701aa960-a43f-4703-8639-b7931a510ced None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:36.059722 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701aa960-a43f-4703-8639-b7931a510ced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:36.065766 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-701aa960-a43f-4703-8639-b7931a510ced None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:29:36.065766 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:36.065766 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:36.065766 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:36.065766 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:36.065766 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:36.065766 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:36.065766 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:36.065766 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:36.065766 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:36.065766 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:36.065766 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:36.065766 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:36.065766 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:36.065766 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:36.065766 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:36.066705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:36.066705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:36.066705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:36.066705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:36.066705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:36.066705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:36.066705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:36.066705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:36.066705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:36.066705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:36.066705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:36.066705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:36.066705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:36.066705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:36.066705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:36.066705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:36.067650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:36.067650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:36.067650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:36.067650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:36.067650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:36.067650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:36.067650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:36.067650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:36.067650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:36.067650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:36.067650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:29:36.067650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:36.069920 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 321/647] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 20:29:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:36.075952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee80db-1f1d-4a04-a6a2-ec8dff64e92c None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:36.189569 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee80db-1f1d-4a04-a6a2-ec8dff64e92c None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:36.191942 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:36.227406 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93a095-7d76-4d4f-a3a5-ba9a3a47e8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:36.228105 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93a095-7d76-4d4f-a3a5-ba9a3a47e8dd None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:36.228400 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93a095-7d76-4d4f-a3a5-ba9a3a47e8dd None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:36.228671 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93a095-7d76-4d4f-a3a5-ba9a3a47e8dd None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:36.229344 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93a095-7d76-4d4f-a3a5-ba9a3a47e8dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:36.229647 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93a095-7d76-4d4f-a3a5-ba9a3a47e8dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:36.231037 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93a095-7d76-4d4f-a3a5-ba9a3a47e8dd None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:36.240795 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 327/648] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:29:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:36.246416 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701aa960-a43f-4703-8639-b7931a510ced None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:36.325773 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aefa7a-60cd-41b0-8e22-172eb5f2e99b None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:36.326104 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aefa7a-60cd-41b0-8e22-172eb5f2e99b None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:36.326315 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aefa7a-60cd-41b0-8e22-172eb5f2e99b None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:36.328434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 328/649] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:29:36.333194 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b17361-88e8-4da0-9f39-c07fcae26cf2 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:36.333427 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b17361-88e8-4da0-9f39-c07fcae26cf2 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:36.333664 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b17361-88e8-4da0-9f39-c07fcae26cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:36.346589 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:36.353841 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-e3b17361-88e8-4da0-9f39-c07fcae26cf2 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:36.355031 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-e3b17361-88e8-4da0-9f39-c07fcae26cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:36.357496 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701aa960-a43f-4703-8639-b7931a510ced None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:36.394640 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c3c17-6318-4112-82a3-6dc88f6da727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:36.395664 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c3c17-6318-4112-82a3-6dc88f6da727 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:36.396230 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c3c17-6318-4112-82a3-6dc88f6da727 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:36.396777 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c3c17-6318-4112-82a3-6dc88f6da727 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:36.408417 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c3c17-6318-4112-82a3-6dc88f6da727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:36.410284 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c3c17-6318-4112-82a3-6dc88f6da727 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:36.427011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-8e1c3c17-6318-4112-82a3-6dc88f6da727 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:36.427011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:36.427011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:36.427011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:36.427011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:36.427011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:36.427011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:36.427011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:36.427011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:36.427011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:36.427011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:36.427011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:36.427011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:36.427011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:36.427011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:36.427011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:36.428097 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:36.428097 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:36.428097 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:36.428097 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:36.428097 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:36.428097 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:36.428097 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:36.428097 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:36.428097 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:36.428097 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:36.428097 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:36.428097 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:36.428097 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:36.428097 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:36.428097 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:36.428097 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:36.428097 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:36.428992 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:36.428992 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:36.428992 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:36.431272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 322/651] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:36.436084 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 329/651] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:29:36.438103 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b17361-88e8-4da0-9f39-c07fcae26cf2 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:36.548621 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:36.554533 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b17361-88e8-4da0-9f39-c07fcae26cf2 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:36.590835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc9dbf-b351-464f-9d12-e6d4a9b51059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:36.591442 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc9dbf-b351-464f-9d12-e6d4a9b51059 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:36.591754 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc9dbf-b351-464f-9d12-e6d4a9b51059 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:36.592544 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc9dbf-b351-464f-9d12-e6d4a9b51059 None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:36.593198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc9dbf-b351-464f-9d12-e6d4a9b51059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:36.593503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc9dbf-b351-464f-9d12-e6d4a9b51059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:36.594916 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc9dbf-b351-464f-9d12-e6d4a9b51059 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:36.607641 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 330/652] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:36.616902 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c3c17-6318-4112-82a3-6dc88f6da727 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:36.632535 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b845b33-b52f-4171-95b9-d180ed85d26a None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:36.632871 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b845b33-b52f-4171-95b9-d180ed85d26a None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:36.633102 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b845b33-b52f-4171-95b9-d180ed85d26a None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:36.634685 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 331/653] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:29:36.641102 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ca3bc-7b4a-4784-b7dc-6d9bc20c6d3a None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:36.641390 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ca3bc-7b4a-4784-b7dc-6d9bc20c6d3a None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:36.641670 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ca3bc-7b4a-4784-b7dc-6d9bc20c6d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:36.660521 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-ac7ca3bc-7b4a-4784-b7dc-6d9bc20c6d3a None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:36.661733 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-ac7ca3bc-7b4a-4784-b7dc-6d9bc20c6d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:36.735914 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 332/654] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:29:36.746638 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c3c17-6318-4112-82a3-6dc88f6da727 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:36.761261 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ca3bc-7b4a-4784-b7dc-6d9bc20c6d3a None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:36.790278 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea2817-cc3a-4392-ae41-891d1214f569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:36.791596 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea2817-cc3a-4392-ae41-891d1214f569 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:36.792378 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea2817-cc3a-4392-ae41-891d1214f569 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:36.792859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea2817-cc3a-4392-ae41-891d1214f569 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:36.804245 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea2817-cc3a-4392-ae41-891d1214f569 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:36.806428 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea2817-cc3a-4392-ae41-891d1214f569 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:36.822564 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-37ea2817-cc3a-4392-ae41-891d1214f569 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:29:36.822564 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:36.822564 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:36.822564 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:36.822564 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:36.822564 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:36.822564 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:36.822564 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:36.822564 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:36.822564 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:36.822564 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:36.822564 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:36.822564 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:29:36.822564 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:29:36.822564 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:29:36.822564 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:29:36.823641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:36.823641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:36.823641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:29:36.823641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:36.823641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:29:36.823641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:36.823641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:36.823641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:36.823641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:36.823641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:36.823641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:36.823641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:36.823641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:36.823641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:36.823641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:36.823641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:36.823641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:36.823641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:36.824621 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:36.824621 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:36.824621 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:29:36.824621 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:29:36.824621 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:29:36.824621 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:29:36.824621 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:29:36.824621 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:29:36.824621 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:29:36.824621 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:36.825216 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 323/655] 10.222.0.15 () {56 vars in 1093 bytes} [Mon Aug 22 20:29:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:36.831272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea2817-cc3a-4392-ae41-891d1214f569 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:36.835605 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:36.861852 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:36.877482 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ca3bc-7b4a-4784-b7dc-6d9bc20c6d3a None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:36.917626 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80f7e7-fcba-49e4-bb42-9b9bb25d20b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:36.918265 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80f7e7-fcba-49e4-bb42-9b9bb25d20b8 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:36.918544 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80f7e7-fcba-49e4-bb42-9b9bb25d20b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:36.918814 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80f7e7-fcba-49e4-bb42-9b9bb25d20b8 None admin] PATH_INFO: `/v3/services/image` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:36.919406 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80f7e7-fcba-49e4-bb42-9b9bb25d20b8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:36.920844 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80f7e7-fcba-49e4-bb42-9b9bb25d20b8 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:36.933211 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-3b80f7e7-fcba-49e4-bb42-9b9bb25d20b8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:29:36.933211 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:36.933211 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:29:36.933211 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:29:36.933211 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:29:36.933211 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:29:36.933211 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:29:36.933211 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:36.933211 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:29:36.933211 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:36.933211 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:29:36.933211 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:36.933211 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:36.933211 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:36.933211 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:36.933211 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:36.933211 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:36.934245 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:36.934245 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:36.934245 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:36.934245 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:36.934245 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:36.934245 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:36.934245 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:29:36.934245 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:29:36.934245 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:29:36.934245 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:29:36.934245 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:36.934245 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:36.934245 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:36.934245 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:36.934245 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:36.934245 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:36.935107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:36.935107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:36.935107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:36.935107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:36.935107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:36.935107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:36.935107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:36.935107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:36.935107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:36.935107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:36.935107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:29:36.935107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:36.935107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:29:36.935107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:36.937800 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 333/656] 10.222.0.15 () {56 vars in 1105 bytes} [Mon Aug 22 20:29:36 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:29:36.938713 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80f7e7-fcba-49e4-bb42-9b9bb25d20b8 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:36.982339 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea2817-cc3a-4392-ae41-891d1214f569 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:37.033105 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df717d-3180-4cf8-8439-72d7e9973893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:37.034785 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df717d-3180-4cf8-8439-72d7e9973893 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:37.035593 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df717d-3180-4cf8-8439-72d7e9973893 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:37.036041 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df717d-3180-4cf8-8439-72d7e9973893 None admin] PATH_INFO: `/v3/users` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:37.036977 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df717d-3180-4cf8-8439-72d7e9973893 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:37.037453 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df717d-3180-4cf8-8439-72d7e9973893 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:37.039953 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df717d-3180-4cf8-8439-72d7e9973893 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:37.051736 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80f7e7-fcba-49e4-bb42-9b9bb25d20b8 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:37.070045 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 324/657] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Aug 22 20:29:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:37.071145 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df717d-3180-4cf8-8439-72d7e9973893 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:37.100236 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b9bec-9f62-43a2-91b7-f415fee1fb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:37.101106 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b9bec-9f62-43a2-91b7-f415fee1fb0b None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:37.101106 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b9bec-9f62-43a2-91b7-f415fee1fb0b None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:37.101967 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b9bec-9f62-43a2-91b7-f415fee1fb0b None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:37.102637 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b9bec-9f62-43a2-91b7-f415fee1fb0b None admin] RBAC: Adding query filter params (name=image) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:37.102947 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b9bec-9f62-43a2-91b7-f415fee1fb0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:37.104492 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b9bec-9f62-43a2-91b7-f415fee1fb0b None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:37.109319 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 334/658] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:37.110137 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b9bec-9f62-43a2-91b7-f415fee1fb0b None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:37.131333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:37.150702 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:37.198791 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df717d-3180-4cf8-8439-72d7e9973893 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:37.224544 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b9bec-9f62-43a2-91b7-f415fee1fb0b None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:37.240928 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376728e-b7f3-42a9-ac7c-25f147b17d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:37.241538 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376728e-b7f3-42a9-ac7c-25f147b17d0a None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:37.241818 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376728e-b7f3-42a9-ac7c-25f147b17d0a None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:37.242093 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376728e-b7f3-42a9-ac7c-25f147b17d0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:37.260991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08b7c6-a715-4598-a16e-2805f2e9398b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:37.261666 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08b7c6-a715-4598-a16e-2805f2e9398b None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:37.261951 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08b7c6-a715-4598-a16e-2805f2e9398b None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:37.262229 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08b7c6-a715-4598-a16e-2805f2e9398b None admin] PATH_INFO: `/v3/services/network` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:37.262822 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08b7c6-a715-4598-a16e-2805f2e9398b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:37.264777 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08b7c6-a715-4598-a16e-2805f2e9398b None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:37.273862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-5c08b7c6-a715-4598-a16e-2805f2e9398b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:29:37.273862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:37.273862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:29:37.273862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:29:37.273862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:29:37.273862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:29:37.273862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:29:37.273862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:37.273862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:29:37.273862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:37.273862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:29:37.273862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:37.273862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:37.273862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:37.273862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:37.273862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:37.273862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:37.275659 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:37.275659 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:37.275659 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:37.275659 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:37.275659 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:37.275659 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:37.275659 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:29:37.275659 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:29:37.275659 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:29:37.275659 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:29:37.275659 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:37.275659 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:37.275659 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:37.275659 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:37.275659 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:37.275659 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:37.276562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:37.276562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:37.276562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:37.276562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:37.276562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:37.276562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:37.276562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:37.276562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:37.276562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:37.276562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:37.276562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:29:37.276562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:37.276562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:29:37.276562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:37.276562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 335/659] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:37 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:37.277343 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08b7c6-a715-4598-a16e-2805f2e9398b None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:37.323063 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376728e-b7f3-42a9-ac7c-25f147b17d0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:37.324623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376728e-b7f3-42a9-ac7c-25f147b17d0a None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:37.367753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:37.385256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:37.391878 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08b7c6-a715-4598-a16e-2805f2e9398b None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:37.427852 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02715f28-fe4f-4a95-8d76-a18f81133313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:37.428471 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02715f28-fe4f-4a95-8d76-a18f81133313 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:37.428760 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02715f28-fe4f-4a95-8d76-a18f81133313 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:37.429196 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 325/660] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:29:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:29:37.429921 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376728e-b7f3-42a9-ac7c-25f147b17d0a None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:37.433711 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02715f28-fe4f-4a95-8d76-a18f81133313 None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:37.434457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02715f28-fe4f-4a95-8d76-a18f81133313 None admin] RBAC: Adding query filter params (type=image) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:37.434784 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02715f28-fe4f-4a95-8d76-a18f81133313 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:37.436995 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02715f28-fe4f-4a95-8d76-a18f81133313 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:37.443296 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 336/661] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:37 2022] GET /identity/v3/services?type=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:37.463619 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02715f28-fe4f-4a95-8d76-a18f81133313 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:37.592984 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376728e-b7f3-42a9-ac7c-25f147b17d0a None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:37.631577 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02715f28-fe4f-4a95-8d76-a18f81133313 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:37.637096 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20cbe0-4fca-479d-b3cf-6905d506393d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:37.637889 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20cbe0-4fca-479d-b3cf-6905d506393d None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:37.638264 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20cbe0-4fca-479d-b3cf-6905d506393d None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:37.638633 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20cbe0-4fca-479d-b3cf-6905d506393d None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:37.639414 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20cbe0-4fca-479d-b3cf-6905d506393d None admin] RBAC: Adding query filter params (name=network) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:37.639844 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20cbe0-4fca-479d-b3cf-6905d506393d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:37.641522 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20cbe0-4fca-479d-b3cf-6905d506393d None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:37.646878 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 326/662] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 20:29:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:37.648451 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb3e21-831f-4193-bef6-75c17cf5fbd4 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:37.648451 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb3e21-831f-4193-bef6-75c17cf5fbd4 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:37.648795 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb3e21-831f-4193-bef6-75c17cf5fbd4 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:37.650399 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 327/663] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:37.655691 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb3e21-831f-4193-bef6-75c17cf5fbd4 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:37.681621 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f328f-c9f9-4614-bde2-24ce87b9e635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:37.682263 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f328f-c9f9-4614-bde2-24ce87b9e635 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:37.682541 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f328f-c9f9-4614-bde2-24ce87b9e635 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:37.682813 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f328f-c9f9-4614-bde2-24ce87b9e635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:37.686678 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:37.696417 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f328f-c9f9-4614-bde2-24ce87b9e635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:37.697976 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f328f-c9f9-4614-bde2-24ce87b9e635 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:37.700027 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:37.713236 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-295f328f-c9f9-4614-bde2-24ce87b9e635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:37.713236 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:37.713236 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:37.713236 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:37.713236 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:37.713236 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:37.713236 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:37.713236 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:37.713236 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:37.713236 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:37.713236 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:37.713236 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:37.713236 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:37.713236 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:37.713236 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:37.713236 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:37.719139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:37.719139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:37.719139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:37.719139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:37.719139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:37.719139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:37.719139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:37.719139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:37.719139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:37.719139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:37.719139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:37.719139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:37.719139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:37.719139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:37.719139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:37.719139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:37.719139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:37.720311 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:37.720311 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:37.720311 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:37.720311 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 337/664] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:37.720311 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348db6b-62c3-43fa-aa6b-7383839c3d2b None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:37.720311 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348db6b-62c3-43fa-aa6b-7383839c3d2b None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:37.720311 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348db6b-62c3-43fa-aa6b-7383839c3d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:37.737368 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-9348db6b-62c3-43fa-aa6b-7383839c3d2b None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:37.738878 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-9348db6b-62c3-43fa-aa6b-7383839c3d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:37.791172 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb3e21-831f-4193-bef6-75c17cf5fbd4 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:37.821094 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 338/665] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:29:37.822162 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348db6b-62c3-43fa-aa6b-7383839c3d2b None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:37.836356 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af881a74-36d3-412b-9861-2f62ecad71fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:37.837244 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af881a74-36d3-412b-9861-2f62ecad71fe None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:37.837674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af881a74-36d3-412b-9861-2f62ecad71fe None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:37.838095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af881a74-36d3-412b-9861-2f62ecad71fe None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:37.838986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af881a74-36d3-412b-9861-2f62ecad71fe None admin] RBAC: Adding query filter params (type=network) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:37.839437 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af881a74-36d3-412b-9861-2f62ecad71fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:37.841141 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af881a74-36d3-412b-9861-2f62ecad71fe None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:37.856166 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 328/666] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 20:29:37 2022] GET /identity/v3/services?type=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:37.942575 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348db6b-62c3-43fa-aa6b-7383839c3d2b None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:37.971935 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:37.986684 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc27915-6fff-403b-953b-1a38aac75d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:37.987307 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc27915-6fff-403b-953b-1a38aac75d7d None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:37.987613 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc27915-6fff-403b-953b-1a38aac75d7d None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:37.987889 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc27915-6fff-403b-953b-1a38aac75d7d None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:37.988545 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc27915-6fff-403b-953b-1a38aac75d7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:37.988847 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc27915-6fff-403b-953b-1a38aac75d7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:37.990446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc27915-6fff-403b-953b-1a38aac75d7d None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:38.004333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 339/667] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:38.009732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af881a74-36d3-412b-9861-2f62ecad71fe None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:38.112624 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:38.125029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af881a74-36d3-412b-9861-2f62ecad71fe None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:38.157973 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc27915-6fff-403b-953b-1a38aac75d7d None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:38.161486 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42508943-a7f3-4181-8112-6a4d34f1473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:38.162135 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42508943-a7f3-4181-8112-6a4d34f1473e None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:38.162419 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42508943-a7f3-4181-8112-6a4d34f1473e None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:38.162699 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42508943-a7f3-4181-8112-6a4d34f1473e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:38.170052 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42508943-a7f3-4181-8112-6a4d34f1473e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:38.172067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42508943-a7f3-4181-8112-6a4d34f1473e None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:38.186783 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-42508943-a7f3-4181-8112-6a4d34f1473e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:38.186783 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:38.186783 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:38.186783 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:38.186783 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:38.186783 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:38.186783 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:38.186783 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:38.186783 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:38.186783 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:38.186783 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:38.186783 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:38.186783 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:29:38.186783 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:29:38.186783 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:29:38.187803 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:29:38.187803 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:38.187803 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:38.187803 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:38.187803 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:38.187803 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:38.187803 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:38.187803 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:38.187803 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:38.187803 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:38.187803 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:38.187803 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:38.187803 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:38.187803 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:38.187803 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:38.187803 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:38.187803 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:38.188727 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:29:38.188727 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:29:38.188727 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:29:38.188727 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:29:38.188727 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:29:38.188727 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:29:38.188727 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:38.188727 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:38.188727 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 329/668] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:38.193941 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42508943-a7f3-4181-8112-6a4d34f1473e None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:38.286378 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc27915-6fff-403b-953b-1a38aac75d7d None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:38.312208 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42508943-a7f3-4181-8112-6a4d34f1473e None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:38.331485 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744bf39-1e59-4908-9a89-3e9f3037be7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:38.332654 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744bf39-1e59-4908-9a89-3e9f3037be7b None admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:38.333303 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744bf39-1e59-4908-9a89-3e9f3037be7b None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:38.333935 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744bf39-1e59-4908-9a89-3e9f3037be7b None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:38.335047 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744bf39-1e59-4908-9a89-3e9f3037be7b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:38.336981 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744bf39-1e59-4908-9a89-3e9f3037be7b None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:38.352248 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20480270-79d6-4cc3-afd3-286e5e4c4214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:38.352836 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20480270-79d6-4cc3-afd3-286e5e4c4214 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:38.353118 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20480270-79d6-4cc3-afd3-286e5e4c4214 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:38.353389 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20480270-79d6-4cc3-afd3-286e5e4c4214 None admin] PATH_INFO: `/v3/projects` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:38.354083 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20480270-79d6-4cc3-afd3-286e5e4c4214 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:38.354387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20480270-79d6-4cc3-afd3-286e5e4c4214 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:38.355844 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20480270-79d6-4cc3-afd3-286e5e4c4214 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:38.368390 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 330/669] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 20:29:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:38.374146 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20480270-79d6-4cc3-afd3-286e5e4c4214 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:38.386132 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:38.489525 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20480270-79d6-4cc3-afd3-286e5e4c4214 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:38.491696 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 340/670] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 20:29:38 2022] POST /identity/v3/services => generated 251 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:29:38.552507 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043a51a-38e2-4bf6-9d1c-a7451377c9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:38.553556 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043a51a-38e2-4bf6-9d1c-a7451377c9a5 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:38.554054 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043a51a-38e2-4bf6-9d1c-a7451377c9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:38.554532 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043a51a-38e2-4bf6-9d1c-a7451377c9a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:38.555519 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043a51a-38e2-4bf6-9d1c-a7451377c9a5 None admin] RBAC: Adding query filter params (role.id=1e3ce9c8b9934a7bb515b39e21fc1d68, scope.project.id=7bda5c44ace24608b8ca69e9059d73ef, user.id=c18d1768fb7a4bac93b28d095b74caf6) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:38.556149 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043a51a-38e2-4bf6-9d1c-a7451377c9a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:38.557948 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043a51a-38e2-4bf6-9d1c-a7451377c9a5 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:38.565461 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 331/671] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:29:38 2022] GET /identity/v3/role_assignments?user.id=c18d1768fb7a4bac93b28d095b74caf6&scope.project.id=7bda5c44ace24608b8ca69e9059d73ef&role.id=1e3ce9c8b9934a7bb515b39e21fc1d68 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:39.776101 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427623a-3941-4cf9-a504-e005b232807b None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:39.776638 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427623a-3941-4cf9-a504-e005b232807b None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:39.776638 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427623a-3941-4cf9-a504-e005b232807b None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:39.778212 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 341/672] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:39.783500 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f9bd1-ff28-4ef3-a339-86109a517172 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:39.783910 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f9bd1-ff28-4ef3-a339-86109a517172 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:39.784078 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f9bd1-ff28-4ef3-a339-86109a517172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:39.803032 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-0c5f9bd1-ff28-4ef3-a339-86109a517172 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:39.804301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-0c5f9bd1-ff28-4ef3-a339-86109a517172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:39.872128 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:39.878430 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 332/673] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:29:40.188347 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4649e2-a222-456a-ba45-32ebc3ab37dd None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:40.188735 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4649e2-a222-456a-ba45-32ebc3ab37dd None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:40.188939 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4649e2-a222-456a-ba45-32ebc3ab37dd None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:40.190477 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 342/674] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:40.196283 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef22854-9114-4602-9bb5-94392ef8aa4d None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:40.196564 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef22854-9114-4602-9bb5-94392ef8aa4d None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:40.196836 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef22854-9114-4602-9bb5-94392ef8aa4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:40.213384 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4649e2-a222-456a-ba45-32ebc3ab37dd None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:40.215430 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-0ef22854-9114-4602-9bb5-94392ef8aa4d None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:40.217433 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-0ef22854-9114-4602-9bb5-94392ef8aa4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:40.268957 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:40.315570 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 333/675] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:40 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:29:40.338191 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4649e2-a222-456a-ba45-32ebc3ab37dd None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:40.376222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e2cd9-d66d-42c5-8dd3-99191b9553ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:40.376928 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e2cd9-d66d-42c5-8dd3-99191b9553ea None admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:40.377212 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e2cd9-d66d-42c5-8dd3-99191b9553ea None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:40.377485 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e2cd9-d66d-42c5-8dd3-99191b9553ea None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:40.378193 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e2cd9-d66d-42c5-8dd3-99191b9553ea None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:40.379751 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e2cd9-d66d-42c5-8dd3-99191b9553ea None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:40.474681 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 343/676] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 20:29:40 2022] POST /identity/v3/services => generated 242 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:29:40.656340 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef22854-9114-4602-9bb5-94392ef8aa4d None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:40.761906 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef22854-9114-4602-9bb5-94392ef8aa4d None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:40.793619 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:40.806597 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f0458-e359-45a1-b61e-96637132f713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:40.807203 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f0458-e359-45a1-b61e-96637132f713 None admin] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:40.807483 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f0458-e359-45a1-b61e-96637132f713 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:40.807785 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f0458-e359-45a1-b61e-96637132f713 None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:40.808422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f0458-e359-45a1-b61e-96637132f713 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:40.809811 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f0458-e359-45a1-b61e-96637132f713 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:40.822203 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eccde-d503-4e2b-a0af-e2ad18861042 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:40.822706 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eccde-d503-4e2b-a0af-e2ad18861042 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:40.822804 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eccde-d503-4e2b-a0af-e2ad18861042 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:40.824136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 344/677] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:29:40.829871 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343412cf-ad66-4c6d-94dd-59dfe50930e9 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:40.830163 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343412cf-ad66-4c6d-94dd-59dfe50930e9 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:40.830443 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343412cf-ad66-4c6d-94dd-59dfe50930e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:40.849257 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-343412cf-ad66-4c6d-94dd-59dfe50930e9 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:40.850878 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-343412cf-ad66-4c6d-94dd-59dfe50930e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:40.928571 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 334/678] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 20:29:40 2022] POST /identity/v3/services => generated 240 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:29:40.931777 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 345/679] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:40 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:29:40.939685 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5260c-9f7f-44f3-ac0b-d59bf007f6a2 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:40.939685 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5260c-9f7f-44f3-ac0b-d59bf007f6a2 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:40.940077 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5260c-9f7f-44f3-ac0b-d59bf007f6a2 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:40.941941 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 335/680] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:40.948405 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff903b5-25f8-4df9-a8b3-f0a92fa21422 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:40.948753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff903b5-25f8-4df9-a8b3-f0a92fa21422 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:40.949028 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff903b5-25f8-4df9-a8b3-f0a92fa21422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:40.973719 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-5ff903b5-25f8-4df9-a8b3-f0a92fa21422 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:40.975264 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-5ff903b5-25f8-4df9-a8b3-f0a92fa21422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:41.015002 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:41.081269 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 346/681] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:40 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:29:41.305318 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5260c-9f7f-44f3-ac0b-d59bf007f6a2 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:41.420802 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff903b5-25f8-4df9-a8b3-f0a92fa21422 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:41.425039 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5260c-9f7f-44f3-ac0b-d59bf007f6a2 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:41.464126 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e668db-f36e-40ac-a89d-a9ca48e769f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:41.465137 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e668db-f36e-40ac-a89d-a9ca48e769f3 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:41.465620 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e668db-f36e-40ac-a89d-a9ca48e769f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:41.466093 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e668db-f36e-40ac-a89d-a9ca48e769f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:41.478879 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e668db-f36e-40ac-a89d-a9ca48e769f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:41.485011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-f1e668db-f36e-40ac-a89d-a9ca48e769f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:29:41.485011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:41.485011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:41.485011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:41.485011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:41.485011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:41.485011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:41.485011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:41.485011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:41.485011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:41.485011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:41.485011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:41.485011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:41.485011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:41.485011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:41.485011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:41.485970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:41.485970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:41.485970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:41.485970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:41.485970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:41.485970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:41.485970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:41.485970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:41.485970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:41.485970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:41.485970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:41.485970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:41.485970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:41.485970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:41.485970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:41.485970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:41.486820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:41.486820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:41.486820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:41.486820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:41.486820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:41.486820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:41.486820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:41.486820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:41.486820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:41.486820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:41.486820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:29:41.486820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:41.494908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 336/682] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 20:29:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:41.496613 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e668db-f36e-40ac-a89d-a9ca48e769f3 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:41.544172 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff903b5-25f8-4df9-a8b3-f0a92fa21422 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:41.567634 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:41.589812 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037259fa-e670-4d21-8800-8d1694eae801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:41.596033 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037259fa-e670-4d21-8800-8d1694eae801 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:41.596033 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037259fa-e670-4d21-8800-8d1694eae801 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:41.596033 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037259fa-e670-4d21-8800-8d1694eae801 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:41.596033 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037259fa-e670-4d21-8800-8d1694eae801 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:41.596033 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037259fa-e670-4d21-8800-8d1694eae801 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:41.603932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-037259fa-e670-4d21-8800-8d1694eae801 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:29:41.603932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:41.603932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:29:41.603932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:29:41.603932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:29:41.603932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:29:41.603932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:29:41.603932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:41.603932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:29:41.603932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:41.603932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:29:41.603932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:41.603932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:41.603932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:41.603932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:41.603932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:41.603932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:41.604977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:41.604977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:41.604977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:41.604977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:41.604977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:41.604977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:41.604977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:29:41.604977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:29:41.604977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:29:41.604977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:29:41.604977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:41.604977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:41.604977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:41.604977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:41.604977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:41.604977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:41.605811 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:41.605811 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:41.605811 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:41.605811 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:41.605811 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:41.605811 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:41.605811 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:41.605811 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:41.605811 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:41.605811 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:41.605811 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:29:41.605811 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:41.605811 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:29:41.605811 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:41.613907 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 347/683] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Aug 22 20:29:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:41.615166 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037259fa-e670-4d21-8800-8d1694eae801 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:41.626902 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e668db-f36e-40ac-a89d-a9ca48e769f3 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:41.643637 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:41.664417 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7702f0-dd06-43d2-a78f-e9eecd0ccc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:41.665151 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7702f0-dd06-43d2-a78f-e9eecd0ccc46 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:41.665622 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7702f0-dd06-43d2-a78f-e9eecd0ccc46 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:41.665732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7702f0-dd06-43d2-a78f-e9eecd0ccc46 None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:41.670817 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7702f0-dd06-43d2-a78f-e9eecd0ccc46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:41.670817 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7702f0-dd06-43d2-a78f-e9eecd0ccc46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:41.670817 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7702f0-dd06-43d2-a78f-e9eecd0ccc46 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:41.678485 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 337/684] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:29:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:41.685129 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7702f0-dd06-43d2-a78f-e9eecd0ccc46 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:41.734593 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037259fa-e670-4d21-8800-8d1694eae801 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:41.778823 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c9e40-52f7-47da-a8d5-664a8699e37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:41.780204 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c9e40-52f7-47da-a8d5-664a8699e37b None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:41.780829 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c9e40-52f7-47da-a8d5-664a8699e37b None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:41.782091 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c9e40-52f7-47da-a8d5-664a8699e37b None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:41.782853 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c9e40-52f7-47da-a8d5-664a8699e37b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:41.783309 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c9e40-52f7-47da-a8d5-664a8699e37b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:41.784837 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c9e40-52f7-47da-a8d5-664a8699e37b None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:41.792116 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 348/685] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Aug 22 20:29:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:41.798029 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c9e40-52f7-47da-a8d5-664a8699e37b None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:41.821667 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7702f0-dd06-43d2-a78f-e9eecd0ccc46 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:41.830115 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:41.860653 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e39cf-8265-4121-9b8a-a7255f5067c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:41.861704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e39cf-8265-4121-9b8a-a7255f5067c1 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:41.862216 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e39cf-8265-4121-9b8a-a7255f5067c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:41.862740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e39cf-8265-4121-9b8a-a7255f5067c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:41.874626 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e39cf-8265-4121-9b8a-a7255f5067c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:41.876564 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e39cf-8265-4121-9b8a-a7255f5067c1 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:41.892561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-774e39cf-8265-4121-9b8a-a7255f5067c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:41.892561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:41.892561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:41.892561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:41.892561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:41.892561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:41.892561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:41.892561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:41.892561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:41.892561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:41.892561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:41.892561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:41.892561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:41.892561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:41.892561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:41.892561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:41.893546 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:41.893546 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:41.893546 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:41.893546 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:41.893546 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:41.893546 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:41.893546 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:41.893546 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:41.893546 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:41.893546 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:41.893546 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:41.893546 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:41.893546 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:41.893546 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:41.893546 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:41.893546 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:41.893546 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:41.894458 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:41.894458 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:41.894458 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:41.894639 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:41.901522 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 338/686] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:29:41.902694 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e39cf-8265-4121-9b8a-a7255f5067c1 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:41.906992 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c9e40-52f7-47da-a8d5-664a8699e37b None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:41.944670 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045f726-97f3-4ad5-a74d-b55e80ca14a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:41.944915 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045f726-97f3-4ad5-a74d-b55e80ca14a6 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:41.945143 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045f726-97f3-4ad5-a74d-b55e80ca14a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:41.945400 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045f726-97f3-4ad5-a74d-b55e80ca14a6 None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:41.946032 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045f726-97f3-4ad5-a74d-b55e80ca14a6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:41.946340 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045f726-97f3-4ad5-a74d-b55e80ca14a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:41.947749 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045f726-97f3-4ad5-a74d-b55e80ca14a6 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:41.953728 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 349/687] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Aug 22 20:29:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:41.959317 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045f726-97f3-4ad5-a74d-b55e80ca14a6 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:42.016577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e39cf-8265-4121-9b8a-a7255f5067c1 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:42.064927 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9606ad-2f00-4a20-b814-091e2685d713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:42.065950 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9606ad-2f00-4a20-b814-091e2685d713 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:42.066238 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9606ad-2f00-4a20-b814-091e2685d713 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:42.066561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9606ad-2f00-4a20-b814-091e2685d713 None admin] PATH_INFO: `/v3/domains` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:42.067488 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9606ad-2f00-4a20-b814-091e2685d713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:42.067827 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9606ad-2f00-4a20-b814-091e2685d713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:42.069397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9606ad-2f00-4a20-b814-091e2685d713 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:42.077105 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045f726-97f3-4ad5-a74d-b55e80ca14a6 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:42.091110 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 339/688] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:42.093273 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9606ad-2f00-4a20-b814-091e2685d713 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:42.119430 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:42.129456 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e57c40-5df4-421f-bef5-813c91d1d6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:42.132861 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e57c40-5df4-421f-bef5-813c91d1d6d2 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:42.132861 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e57c40-5df4-421f-bef5-813c91d1d6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:42.132861 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e57c40-5df4-421f-bef5-813c91d1d6d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:42.132861 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e57c40-5df4-421f-bef5-813c91d1d6d2 None admin] RBAC: Adding query filter params (interface=public, service_id=87925a3bac354c5892f17e129d489111, region_id=RegionOne) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:42.133518 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e57c40-5df4-421f-bef5-813c91d1d6d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:42.135601 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e57c40-5df4-421f-bef5-813c91d1d6d2 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:42.146554 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 350/689] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Aug 22 20:29:41 2022] GET /identity/v3/endpoints?service_id=87925a3bac354c5892f17e129d489111&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:42.151223 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e57c40-5df4-421f-bef5-813c91d1d6d2 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:42.173110 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:42.227986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9606ad-2f00-4a20-b814-091e2685d713 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:42.265391 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cb5ff-978d-4ecb-b8c2-027bfca7d120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:42.266082 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cb5ff-978d-4ecb-b8c2-027bfca7d120 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:42.266369 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cb5ff-978d-4ecb-b8c2-027bfca7d120 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:42.266643 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cb5ff-978d-4ecb-b8c2-027bfca7d120 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:42.272426 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e57c40-5df4-421f-bef5-813c91d1d6d2 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:42.274398 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2cb5ff-978d-4ecb-b8c2-027bfca7d120 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:42.276010 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2cb5ff-978d-4ecb-b8c2-027bfca7d120 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:42.288652 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-6d2cb5ff-978d-4ecb-b8c2-027bfca7d120 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:29:42.288652 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:42.288652 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:42.288652 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:42.288652 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:42.288652 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:42.288652 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:42.288652 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:42.288652 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:42.288652 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:42.288652 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:42.288652 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:42.288652 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:29:42.288652 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:29:42.288652 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:29:42.288652 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:29:42.289642 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:42.289642 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:42.289642 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:29:42.289642 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:42.289642 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:29:42.289642 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:42.289642 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:42.289642 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:42.289642 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:42.289642 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:42.289642 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:42.289642 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:42.289642 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:42.289642 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:42.289642 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:42.289642 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:42.289642 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:42.289642 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:42.291077 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:42.291077 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:42.291077 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:29:42.291077 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:29:42.291077 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:29:42.291077 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:29:42.291077 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:29:42.291077 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:29:42.291077 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:29:42.291077 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:42.291077 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 340/690] 10.222.0.15 () {56 vars in 1093 bytes} [Mon Aug 22 20:29:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:42.295300 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cb5ff-978d-4ecb-b8c2-027bfca7d120 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:42.321403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b48f0c-b636-4ffa-95bb-a2792acb8429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:42.322447 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b48f0c-b636-4ffa-95bb-a2792acb8429 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:42.322919 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b48f0c-b636-4ffa-95bb-a2792acb8429 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:42.323407 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b48f0c-b636-4ffa-95bb-a2792acb8429 None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:42.324170 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b48f0c-b636-4ffa-95bb-a2792acb8429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:42.326139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b48f0c-b636-4ffa-95bb-a2792acb8429 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:42.335711 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 351/691] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Aug 22 20:29:42 2022] GET /identity/v3/services => generated 1002 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:29:42.396923 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:42.422814 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cb5ff-978d-4ecb-b8c2-027bfca7d120 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:42.470560 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b620f-288b-432a-bef4-1d0a5cbb8890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:42.471647 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b620f-288b-432a-bef4-1d0a5cbb8890 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:42.472178 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b620f-288b-432a-bef4-1d0a5cbb8890 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:42.472667 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b620f-288b-432a-bef4-1d0a5cbb8890 None admin] PATH_INFO: `/v3/users` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:42.473685 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b620f-288b-432a-bef4-1d0a5cbb8890 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:42.474230 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b620f-288b-432a-bef4-1d0a5cbb8890 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:42.476255 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b620f-288b-432a-bef4-1d0a5cbb8890 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:42.498669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 341/692] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Aug 22 20:29:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:42.505058 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b48f0c-b636-4ffa-95bb-a2792acb8429 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:42.601464 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:42.621561 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b48f0c-b636-4ffa-95bb-a2792acb8429 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:42.659051 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f336b-c76e-469e-bca9-4024fad44008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:42.660179 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f336b-c76e-469e-bca9-4024fad44008 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:42.660668 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f336b-c76e-469e-bca9-4024fad44008 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:42.661217 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f336b-c76e-469e-bca9-4024fad44008 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:42.672956 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f336b-c76e-469e-bca9-4024fad44008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:42.674859 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f336b-c76e-469e-bca9-4024fad44008 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:42.693428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-082f336b-c76e-469e-bca9-4024fad44008 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:42.693428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:42.693428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:42.693428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:42.693428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:42.693428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:42.693428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:42.693428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:42.693428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:42.693428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:42.693428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:42.693428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:42.693428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:42.693428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:42.693428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:42.693428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:42.694455 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:42.694455 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:42.694455 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:42.694455 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:42.694455 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:42.694455 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:42.694455 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:42.694455 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:42.694455 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:42.694455 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:42.694455 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:42.694455 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:42.694455 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:42.694455 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:42.694455 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:42.694455 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:42.694455 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:42.695361 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:42.695361 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:42.695361 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:42.697684 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 352/693] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:42.704566 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b620f-288b-432a-bef4-1d0a5cbb8890 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:42.814578 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b620f-288b-432a-bef4-1d0a5cbb8890 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:42.851139 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c73f89-53c1-45cd-adbc-49c28a250044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:42.852725 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c73f89-53c1-45cd-adbc-49c28a250044 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:42.853238 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c73f89-53c1-45cd-adbc-49c28a250044 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:42.853821 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c73f89-53c1-45cd-adbc-49c28a250044 None admin] PATH_INFO: `/v3/domains` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:42.854764 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c73f89-53c1-45cd-adbc-49c28a250044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:42.855273 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c73f89-53c1-45cd-adbc-49c28a250044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:42.856082 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc59980-481e-47b8-b539-71a34a022a89 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:42.856365 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc59980-481e-47b8-b539-71a34a022a89 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:42.856638 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc59980-481e-47b8-b539-71a34a022a89 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:42.858066 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c73f89-53c1-45cd-adbc-49c28a250044 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:42.859774 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 353/694] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:29:42.861261 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:42.864205 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdf2d5-4109-4e26-9d27-147a0b270335 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:42.864491 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdf2d5-4109-4e26-9d27-147a0b270335 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:42.864767 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdf2d5-4109-4e26-9d27-147a0b270335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:42.874931 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 342/695] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:42.881210 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c73f89-53c1-45cd-adbc-49c28a250044 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:42.885596 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-3bcdf2d5-4109-4e26-9d27-147a0b270335 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:42.886899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-3bcdf2d5-4109-4e26-9d27-147a0b270335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:42.982435 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 354/696] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:42 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:29:43.005958 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c73f89-53c1-45cd-adbc-49c28a250044 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:43.046985 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9c5db-b86c-44cd-bf74-ff89fcdac38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:43.047686 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9c5db-b86c-44cd-bf74-ff89fcdac38c None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:43.047967 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9c5db-b86c-44cd-bf74-ff89fcdac38c None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:43.048241 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9c5db-b86c-44cd-bf74-ff89fcdac38c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:43.056604 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9c5db-b86c-44cd-bf74-ff89fcdac38c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:43.058155 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9c5db-b86c-44cd-bf74-ff89fcdac38c None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:43.070971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-6cb9c5db-b86c-44cd-bf74-ff89fcdac38c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:43.070971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:43.070971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:43.070971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:43.070971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:43.070971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:43.070971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:43.070971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:43.070971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:43.070971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:43.070971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:43.070971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:43.070971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:29:43.070971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:29:43.070971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:29:43.071954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:29:43.071954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:43.071954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:43.071954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:43.071954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:43.071954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:43.071954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:43.071954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:43.071954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:43.071954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:43.071954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:43.071954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:43.071954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:43.071954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:43.071954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:43.071954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:43.071954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:43.072866 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:29:43.072866 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:29:43.072866 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:29:43.072866 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:29:43.072866 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:29:43.072866 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:29:43.072866 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:43.072866 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:43.072866 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 343/697] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:43.080692 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdf2d5-4109-4e26-9d27-147a0b270335 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:43.148680 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:43.189434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdf2d5-4109-4e26-9d27-147a0b270335 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:43.195656 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb1496-33ee-49dd-99cf-1f726be90b48 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:43.195939 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb1496-33ee-49dd-99cf-1f726be90b48 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:43.196282 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb1496-33ee-49dd-99cf-1f726be90b48 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:43.197889 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 344/698] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:43.205955 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e2b5b-7c1d-4f75-9f2e-dc97f85e625c None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:43.206526 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e2b5b-7c1d-4f75-9f2e-dc97f85e625c None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:43.207364 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e2b5b-7c1d-4f75-9f2e-dc97f85e625c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:43.233022 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-634e2b5b-7c1d-4f75-9f2e-dc97f85e625c None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:43.234858 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-634e2b5b-7c1d-4f75-9f2e-dc97f85e625c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:43.235383 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a4913-c401-48c6-bdf7-03c5f8d528d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:43.236037 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a4913-c401-48c6-bdf7-03c5f8d528d6 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:43.236317 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a4913-c401-48c6-bdf7-03c5f8d528d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:43.236654 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a4913-c401-48c6-bdf7-03c5f8d528d6 None admin] PATH_INFO: `/v3/projects` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:43.237367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a4913-c401-48c6-bdf7-03c5f8d528d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:43.237676 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a4913-c401-48c6-bdf7-03c5f8d528d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:43.240360 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a4913-c401-48c6-bdf7-03c5f8d528d6 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:43.261717 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 355/699] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 20:29:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:43.262794 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a4913-c401-48c6-bdf7-03c5f8d528d6 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:43.298201 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:43.316689 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 345/700] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:43 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:29:43.317586 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e2b5b-7c1d-4f75-9f2e-dc97f85e625c None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:43.380339 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a4913-c401-48c6-bdf7-03c5f8d528d6 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:43.418551 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81792dbe-72c1-4c13-ba89-010225c51959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:43.419577 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81792dbe-72c1-4c13-ba89-010225c51959 None admin] REQUEST_METHOD: `PUT` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:43.420107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81792dbe-72c1-4c13-ba89-010225c51959 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:43.420681 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81792dbe-72c1-4c13-ba89-010225c51959 None admin] PATH_INFO: `/v3/projects/7bda5c44ace24608b8ca69e9059d73ef/users/c18d1768fb7a4bac93b28d095b74caf6/roles/1e3ce9c8b9934a7bb515b39e21fc1d68` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:43.423205 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81792dbe-72c1-4c13-ba89-010225c51959 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bda5c44ace24608b8ca69e9059d73ef, user_id=c18d1768fb7a4bac93b28d095b74caf6, role_id=1e3ce9c8b9934a7bb515b39e21fc1d68)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:43.427521 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e2b5b-7c1d-4f75-9f2e-dc97f85e625c None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:43.427769 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:43.428274 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81792dbe-72c1-4c13-ba89-010225c51959 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:43.469957 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b1c85-09ce-49f7-8bec-c91eacf6cb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:43.470631 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b1c85-09ce-49f7-8bec-c91eacf6cb9a None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:43.470920 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b1c85-09ce-49f7-8bec-c91eacf6cb9a None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:43.471193 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b1c85-09ce-49f7-8bec-c91eacf6cb9a None admin] PATH_INFO: `/v3/services/image` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:43.471809 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b1c85-09ce-49f7-8bec-c91eacf6cb9a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:43.473185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b1c85-09ce-49f7-8bec-c91eacf6cb9a None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:43.484824 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-232b1c85-09ce-49f7-8bec-c91eacf6cb9a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:29:43.484824 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:43.484824 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:29:43.484824 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:29:43.484824 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:29:43.484824 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:29:43.484824 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:29:43.484824 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:43.484824 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:29:43.484824 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:43.484824 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:29:43.484824 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:43.484824 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:43.484824 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:43.484824 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:43.484824 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:43.484824 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:43.485870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:43.485870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:43.485870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:43.485870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:43.485870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:43.485870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:43.485870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:29:43.485870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:29:43.485870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:29:43.485870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:29:43.485870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:43.485870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:43.485870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:43.485870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:43.485870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:43.485870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:43.486784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:43.486784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:43.486784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:43.486784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:43.486784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:43.486784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:43.486784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:43.486784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:43.486784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:43.486784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:43.486784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:29:43.486784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:43.486784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:29:43.486784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:43.486784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 346/701] 10.222.0.15 () {56 vars in 1105 bytes} [Mon Aug 22 20:29:43 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:43.491754 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b1c85-09ce-49f7-8bec-c91eacf6cb9a None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:43.540448 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 356/702] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 20:29:43 2022] PUT /identity/v3/projects/7bda5c44ace24608b8ca69e9059d73ef/users/c18d1768fb7a4bac93b28d095b74caf6/roles/1e3ce9c8b9934a7bb515b39e21fc1d68 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:29:43.563750 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:43.628008 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b1c85-09ce-49f7-8bec-c91eacf6cb9a None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:43.652505 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81792dbe-72c1-4c13-ba89-010225c51959 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:43.670766 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06e3ff-e701-40f7-a75a-691bb90a769f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:43.672249 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06e3ff-e701-40f7-a75a-691bb90a769f None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:43.672992 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06e3ff-e701-40f7-a75a-691bb90a769f None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:43.673445 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06e3ff-e701-40f7-a75a-691bb90a769f None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:43.674535 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06e3ff-e701-40f7-a75a-691bb90a769f None admin] RBAC: Adding query filter params (name=image) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:43.675023 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06e3ff-e701-40f7-a75a-691bb90a769f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:43.677099 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06e3ff-e701-40f7-a75a-691bb90a769f None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:43.690097 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 347/703] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:43.693055 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06e3ff-e701-40f7-a75a-691bb90a769f None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:43.785974 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81792dbe-72c1-4c13-ba89-010225c51959 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:43.830881 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e93db4-fe49-4682-a281-3d9ab2ed14c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:43.831683 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e93db4-fe49-4682-a281-3d9ab2ed14c8 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:43.831966 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e93db4-fe49-4682-a281-3d9ab2ed14c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:43.832243 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e93db4-fe49-4682-a281-3d9ab2ed14c8 None admin] PATH_INFO: `/v3/services/network` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:43.832845 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e93db4-fe49-4682-a281-3d9ab2ed14c8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:43.833305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06e3ff-e701-40f7-a75a-691bb90a769f None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:43.834230 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e93db4-fe49-4682-a281-3d9ab2ed14c8 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:43.847125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-04e93db4-fe49-4682-a281-3d9ab2ed14c8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:29:43.847125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:43.847125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:29:43.847125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:29:43.847125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:29:43.847125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:29:43.847125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:29:43.847125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:43.847125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:29:43.847125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:43.847125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:29:43.847125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:43.847125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:43.847125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:43.847125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:43.847125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:43.847125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:43.848254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:43.848254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:43.848254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:43.848254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:43.848254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:43.848254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:43.848254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:29:43.848254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:29:43.848254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:29:43.848254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:29:43.848254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:43.848254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:43.848254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:43.848254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:43.848254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:43.848254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:43.849576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:43.849576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:43.849576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:43.849576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:43.849576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:43.849576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:43.849576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:43.849576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:43.849576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:43.849576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:43.849576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:29:43.849576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:43.849576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:29:43.849576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:43.849576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 357/704] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:43 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:29:43.853022 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:43.855019 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e93db4-fe49-4682-a281-3d9ab2ed14c8 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:43.886493 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0e4db-7fa3-4d1a-a09c-b37d920e1130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:43.887121 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0e4db-7fa3-4d1a-a09c-b37d920e1130 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:43.887586 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0e4db-7fa3-4d1a-a09c-b37d920e1130 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:43.887877 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0e4db-7fa3-4d1a-a09c-b37d920e1130 None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:43.888899 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0e4db-7fa3-4d1a-a09c-b37d920e1130 None admin] RBAC: Adding query filter params (type=image) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:43.889481 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0e4db-7fa3-4d1a-a09c-b37d920e1130 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:43.891059 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0e4db-7fa3-4d1a-a09c-b37d920e1130 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:43.898257 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 348/705] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:43.904133 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0e4db-7fa3-4d1a-a09c-b37d920e1130 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:43.915017 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:43.988180 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e93db4-fe49-4682-a281-3d9ab2ed14c8 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:44.032891 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783b78c-a878-45fe-90eb-20d7d3967860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:44.033897 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783b78c-a878-45fe-90eb-20d7d3967860 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:44.034326 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0e4db-7fa3-4d1a-a09c-b37d920e1130 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:44.034607 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783b78c-a878-45fe-90eb-20d7d3967860 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:44.035084 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783b78c-a878-45fe-90eb-20d7d3967860 None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:44.035978 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783b78c-a878-45fe-90eb-20d7d3967860 None admin] RBAC: Adding query filter params (name=network) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:44.036699 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783b78c-a878-45fe-90eb-20d7d3967860 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:44.039325 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783b78c-a878-45fe-90eb-20d7d3967860 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:44.046288 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 358/706] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 20:29:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:44.055055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783b78c-a878-45fe-90eb-20d7d3967860 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:44.084400 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815cebf-4e03-4811-baf7-3c69bfd7863c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:44.085410 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815cebf-4e03-4811-baf7-3c69bfd7863c None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:44.085900 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815cebf-4e03-4811-baf7-3c69bfd7863c None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:44.086380 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815cebf-4e03-4811-baf7-3c69bfd7863c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:44.087318 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815cebf-4e03-4811-baf7-3c69bfd7863c None admin] RBAC: Adding query filter params (interface=public, service_id=2aa7ac81fb3545688c62f47fdce63eeb, region_id=RegionOne) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:44.087873 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815cebf-4e03-4811-baf7-3c69bfd7863c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:44.089537 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815cebf-4e03-4811-baf7-3c69bfd7863c None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:44.103235 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 349/707] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Aug 22 20:29:43 2022] GET /identity/v3/endpoints?service_id=2aa7ac81fb3545688c62f47fdce63eeb&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:44.104922 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815cebf-4e03-4811-baf7-3c69bfd7863c None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:44.152997 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:44.177973 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783b78c-a878-45fe-90eb-20d7d3967860 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:44.192145 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:44.221020 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815cebf-4e03-4811-baf7-3c69bfd7863c None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:44.222673 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365ee46-6532-4614-a907-96d3e5d0977a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:44.223571 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365ee46-6532-4614-a907-96d3e5d0977a None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:44.223941 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365ee46-6532-4614-a907-96d3e5d0977a None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:44.224287 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365ee46-6532-4614-a907-96d3e5d0977a None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:44.225785 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365ee46-6532-4614-a907-96d3e5d0977a None admin] RBAC: Adding query filter params (type=network) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:44.225785 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365ee46-6532-4614-a907-96d3e5d0977a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:44.228198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365ee46-6532-4614-a907-96d3e5d0977a None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:44.239198 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 359/708] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 20:29:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:44.241907 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365ee46-6532-4614-a907-96d3e5d0977a None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:44.274066 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2972765-c5c6-44e8-98e8-474e3f9352f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:44.274888 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2972765-c5c6-44e8-98e8-474e3f9352f7 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:44.275259 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2972765-c5c6-44e8-98e8-474e3f9352f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:44.275565 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2972765-c5c6-44e8-98e8-474e3f9352f7 None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:44.276190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2972765-c5c6-44e8-98e8-474e3f9352f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:44.278574 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2972765-c5c6-44e8-98e8-474e3f9352f7 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:44.295581 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 350/709] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Aug 22 20:29:44 2022] GET /identity/v3/services => generated 1002 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:29:44.379844 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365ee46-6532-4614-a907-96d3e5d0977a None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:44.420941 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509132d-595b-4c5a-9a1e-97afc37ed133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:44.421574 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509132d-595b-4c5a-9a1e-97afc37ed133 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:44.421985 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509132d-595b-4c5a-9a1e-97afc37ed133 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:44.422265 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509132d-595b-4c5a-9a1e-97afc37ed133 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:44.423132 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509132d-595b-4c5a-9a1e-97afc37ed133 None admin] RBAC: Adding query filter params (interface=public, service_id=0608bff664cd466c9e56983947df27c4, region_id=RegionOne) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:44.423449 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509132d-595b-4c5a-9a1e-97afc37ed133 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:44.424966 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509132d-595b-4c5a-9a1e-97afc37ed133 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:44.431739 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 360/710] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Aug 22 20:29:44 2022] GET /identity/v3/endpoints?service_id=0608bff664cd466c9e56983947df27c4&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:44.440930 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2972765-c5c6-44e8-98e8-474e3f9352f7 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:44.556884 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2972765-c5c6-44e8-98e8-474e3f9352f7 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:44.565334 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:44.598347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7bcdd-8091-48ef-8c6e-6b5bb13f2f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:44.598970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7bcdd-8091-48ef-8c6e-6b5bb13f2f27 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:44.599253 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7bcdd-8091-48ef-8c6e-6b5bb13f2f27 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:44.599528 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7bcdd-8091-48ef-8c6e-6b5bb13f2f27 None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:44.600225 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7bcdd-8091-48ef-8c6e-6b5bb13f2f27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:44.601635 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7bcdd-8091-48ef-8c6e-6b5bb13f2f27 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:44.611702 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 351/711] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Aug 22 20:29:44 2022] GET /identity/v3/services => generated 1002 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:29:44.855083 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8ed7e-5b44-44d3-becc-e59f0e8ada7e None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:44.855418 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8ed7e-5b44-44d3-becc-e59f0e8ada7e None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:44.855793 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8ed7e-5b44-44d3-becc-e59f0e8ada7e None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:44.857467 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 361/712] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:29:44.863691 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b833d67-b07d-433f-829a-f7d1c7f1b541 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:44.864155 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b833d67-b07d-433f-829a-f7d1c7f1b541 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:44.864354 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b833d67-b07d-433f-829a-f7d1c7f1b541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:44.883992 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-4b833d67-b07d-433f-829a-f7d1c7f1b541 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:44.885301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-4b833d67-b07d-433f-829a-f7d1c7f1b541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:44.971674 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 352/713] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:44 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:29:45.302354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8ed7e-5b44-44d3-becc-e59f0e8ada7e None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:45.470731 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:45.557032 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8ed7e-5b44-44d3-becc-e59f0e8ada7e None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:45.595280 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815bccd-ec9b-4990-8b33-5d3c99e08502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:45.596343 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815bccd-ec9b-4990-8b33-5d3c99e08502 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:45.596833 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815bccd-ec9b-4990-8b33-5d3c99e08502 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:45.597312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815bccd-ec9b-4990-8b33-5d3c99e08502 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:45.598111 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815bccd-ec9b-4990-8b33-5d3c99e08502 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:45.599926 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815bccd-ec9b-4990-8b33-5d3c99e08502 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:45.609971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-9815bccd-ec9b-4990-8b33-5d3c99e08502 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:29:45.609971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:45.609971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:29:45.609971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:29:45.609971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:29:45.609971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:29:45.609971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:29:45.609971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:45.609971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:29:45.609971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:45.609971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:29:45.609971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:45.609971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:45.609971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:45.609971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:45.609971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:45.609971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:45.611049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:45.611049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:45.611049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:45.611049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:45.611049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:45.611049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:45.611049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:29:45.611049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:29:45.611049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:29:45.611049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:29:45.611049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:45.611049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:45.611049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:45.611049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:45.611049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:45.611049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:45.612327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:45.612327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:45.612327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:45.612327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:45.612327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:45.612327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:45.612327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:45.612327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:45.612327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:45.612327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:45.612327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:29:45.612327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:45.612327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:29:45.612327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:45.615027 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 362/714] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Aug 22 20:29:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:45.620975 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b833d67-b07d-433f-829a-f7d1c7f1b541 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:45.735912 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:45.742561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b833d67-b07d-433f-829a-f7d1c7f1b541 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:45.783187 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fccf7b-fe83-4429-9d9c-bdf96afb8e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:45.784289 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fccf7b-fe83-4429-9d9c-bdf96afb8e21 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:45.784776 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fccf7b-fe83-4429-9d9c-bdf96afb8e21 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:45.785270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fccf7b-fe83-4429-9d9c-bdf96afb8e21 None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:45.786108 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fccf7b-fe83-4429-9d9c-bdf96afb8e21 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:45.786612 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fccf7b-fe83-4429-9d9c-bdf96afb8e21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:45.788317 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fccf7b-fe83-4429-9d9c-bdf96afb8e21 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:45.794146 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 353/715] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Aug 22 20:29:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:45.800723 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815bccd-ec9b-4990-8b33-5d3c99e08502 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:45.910412 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815bccd-ec9b-4990-8b33-5d3c99e08502 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:45.911896 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:45.947373 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91fd0f-47df-4879-9349-76ab82baaa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:45.948067 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91fd0f-47df-4879-9349-76ab82baaa66 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:45.948350 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91fd0f-47df-4879-9349-76ab82baaa66 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:45.948631 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91fd0f-47df-4879-9349-76ab82baaa66 None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:45.949270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91fd0f-47df-4879-9349-76ab82baaa66 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:45.949579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91fd0f-47df-4879-9349-76ab82baaa66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:45.950950 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91fd0f-47df-4879-9349-76ab82baaa66 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:45.956545 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 363/716] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Aug 22 20:29:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:45.962187 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fccf7b-fe83-4429-9d9c-bdf96afb8e21 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:46.076007 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fccf7b-fe83-4429-9d9c-bdf96afb8e21 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:46.116847 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3f02f-8e44-4d71-a12e-36e7dc6902e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:46.117878 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3f02f-8e44-4d71-a12e-36e7dc6902e6 None admin] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:46.118362 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3f02f-8e44-4d71-a12e-36e7dc6902e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:46.118836 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3f02f-8e44-4d71-a12e-36e7dc6902e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:46.119735 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3f02f-8e44-4d71-a12e-36e7dc6902e6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:46.121352 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3f02f-8e44-4d71-a12e-36e7dc6902e6 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:46.180478 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2de30-63e3-441a-846c-2bbc8260b8e6 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:46.180816 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2de30-63e3-441a-846c-2bbc8260b8e6 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:46.181023 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2de30-63e3-441a-846c-2bbc8260b8e6 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:46.182513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 364/717] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:29:46.187780 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6471f8-4ec1-4afc-afed-e840606cf0ce None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:46.188060 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6471f8-4ec1-4afc-afed-e840606cf0ce None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:46.188328 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6471f8-4ec1-4afc-afed-e840606cf0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:46.206390 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 354/718] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 20:29:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:29:46.206759 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-ee6471f8-4ec1-4afc-afed-e840606cf0ce None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:46.211643 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-ee6471f8-4ec1-4afc-afed-e840606cf0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:46.298787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 365/719] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:46 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:29:46.638337 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3f02f-8e44-4d71-a12e-36e7dc6902e6 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:46.664665 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:46.683234 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268438e5-617a-43d1-a073-cc18ded95cbb None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:46.683788 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268438e5-617a-43d1-a073-cc18ded95cbb None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:46.683788 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268438e5-617a-43d1-a073-cc18ded95cbb None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:46.685575 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 366/720] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:46.691393 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049e514-7cdc-4eea-bf49-b59f1b7ae96c None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:46.691708 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049e514-7cdc-4eea-bf49-b59f1b7ae96c None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:46.691987 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049e514-7cdc-4eea-bf49-b59f1b7ae96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:46.711036 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-9049e514-7cdc-4eea-bf49-b59f1b7ae96c None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:46.713970 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-9049e514-7cdc-4eea-bf49-b59f1b7ae96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:46.763389 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3f02f-8e44-4d71-a12e-36e7dc6902e6 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:46.791234 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 367/721] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:46 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:29:46.812002 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf73ed-1b45-4d6f-b51a-21181d90c3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:46.813154 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf73ed-1b45-4d6f-b51a-21181d90c3e5 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:46.813734 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf73ed-1b45-4d6f-b51a-21181d90c3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:46.814216 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf73ed-1b45-4d6f-b51a-21181d90c3e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:46.827383 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf73ed-1b45-4d6f-b51a-21181d90c3e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:46.832588 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-f5bf73ed-1b45-4d6f-b51a-21181d90c3e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:29:46.832588 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:46.832588 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:46.832588 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:46.832588 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:46.832588 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:46.832588 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:46.832588 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:46.832588 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:46.832588 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:46.832588 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:46.832588 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:46.832588 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:46.832588 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:46.832588 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:46.832588 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:46.843804 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:46.843804 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:46.843804 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:46.843804 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:46.843804 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:46.843804 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:46.843804 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:46.843804 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:46.843804 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:46.843804 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:46.843804 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:46.843804 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:46.843804 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:46.843804 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:46.843804 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:46.843804 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:46.844852 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:46.844852 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:46.844852 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:46.844852 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:46.844852 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:46.844852 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:46.844852 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:46.844852 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:46.844852 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:46.844852 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:46.844852 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:29:46.844852 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:46.844852 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 355/722] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 20:29:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:46.845692 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049e514-7cdc-4eea-bf49-b59f1b7ae96c None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:46.931994 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:46.960224 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049e514-7cdc-4eea-bf49-b59f1b7ae96c None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:46.967058 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2c213-75b5-4db6-b829-b314a4d3c8ff None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:46.974047 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2c213-75b5-4db6-b829-b314a4d3c8ff None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:46.974047 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2c213-75b5-4db6-b829-b314a4d3c8ff None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:46.974047 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 356/723] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:46.977354 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83e41d-a34d-4957-a37b-dd417698b4f8 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:46.977729 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83e41d-a34d-4957-a37b-dd417698b4f8 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:46.978138 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83e41d-a34d-4957-a37b-dd417698b4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:47.002560 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7bb00-b5c0-4c93-80ec-3f7f153f9a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:47.003489 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7bb00-b5c0-4c93-80ec-3f7f153f9a29 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:47.004085 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7bb00-b5c0-4c93-80ec-3f7f153f9a29 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:47.004515 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7bb00-b5c0-4c93-80ec-3f7f153f9a29 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:47.008470 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7bb00-b5c0-4c93-80ec-3f7f153f9a29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:47.008470 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7bb00-b5c0-4c93-80ec-3f7f153f9a29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:47.008470 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7bb00-b5c0-4c93-80ec-3f7f153f9a29 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:47.018997 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 368/724] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:29:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:47.024549 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7bb00-b5c0-4c93-80ec-3f7f153f9a29 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:47.136137 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:47.144224 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-cf83e41d-a34d-4957-a37b-dd417698b4f8 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:47.151597 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-cf83e41d-a34d-4957-a37b-dd417698b4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:47.158771 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7bb00-b5c0-4c93-80ec-3f7f153f9a29 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:47.197751 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cd953-d5b6-410e-a052-280ee4f9ffaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:47.198542 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cd953-d5b6-410e-a052-280ee4f9ffaf None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:47.198823 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cd953-d5b6-410e-a052-280ee4f9ffaf None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:47.199095 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cd953-d5b6-410e-a052-280ee4f9ffaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:47.210815 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817cd953-d5b6-410e-a052-280ee4f9ffaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:47.212309 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817cd953-d5b6-410e-a052-280ee4f9ffaf None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:47.229761 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-817cd953-d5b6-410e-a052-280ee4f9ffaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:47.229761 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:47.229761 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:47.229761 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:47.229761 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:47.229761 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:47.229761 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:47.229761 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:47.229761 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:47.229761 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:47.229761 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:47.229761 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:47.229761 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:47.229761 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:47.229761 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:47.229761 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:47.239989 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:47.239989 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:47.239989 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:47.239989 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:47.239989 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:47.239989 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:47.239989 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:47.239989 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:47.239989 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:47.239989 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:47.239989 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:47.239989 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:47.239989 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:47.239989 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:47.239989 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:47.239989 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:47.239989 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:47.241856 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:47.241856 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:47.241856 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:47.241856 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 369/725] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:29:47.241856 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cd953-d5b6-410e-a052-280ee4f9ffaf None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:47.242437 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 357/726] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:46 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:29:47.242437 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83e41d-a34d-4957-a37b-dd417698b4f8 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:47.256358 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:47.358019 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cd953-d5b6-410e-a052-280ee4f9ffaf None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:47.388740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83e41d-a34d-4957-a37b-dd417698b4f8 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:47.403363 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dd854-1656-4c80-9fc7-ceed41fcfd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:47.404217 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dd854-1656-4c80-9fc7-ceed41fcfd7c None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:47.404860 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dd854-1656-4c80-9fc7-ceed41fcfd7c None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:47.405237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dd854-1656-4c80-9fc7-ceed41fcfd7c None admin] PATH_INFO: `/v3/services/image` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:47.406434 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dd854-1656-4c80-9fc7-ceed41fcfd7c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:47.408643 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dd854-1656-4c80-9fc7-ceed41fcfd7c None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:47.412120 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:47.423055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-305dd854-1656-4c80-9fc7-ceed41fcfd7c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:29:47.423055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:47.423055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:29:47.423055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:29:47.423055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:29:47.423055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:29:47.423055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:29:47.423055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:47.423055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:29:47.423055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:47.423055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:29:47.423055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:47.423055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:47.423055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:47.423055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:47.423055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:47.423055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:47.424203 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:47.424203 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:47.424203 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:47.424203 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:47.424203 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:47.424203 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:47.424203 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:29:47.424203 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:29:47.424203 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:29:47.424203 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:29:47.424203 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:47.424203 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:47.424203 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:47.424203 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:47.424203 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:47.424203 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:47.425058 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:47.425058 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:47.425058 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:47.425058 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:47.425058 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:47.425058 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:47.425058 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:47.425058 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:47.425058 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:47.425058 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:47.425058 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:29:47.425058 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:47.425058 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:29:47.425058 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:47.425058 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 370/727] 10.222.0.15 () {56 vars in 1105 bytes} [Mon Aug 22 20:29:47 2022] GET /identity/v3/services/image => generated 86 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:47.431411 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dd854-1656-4c80-9fc7-ceed41fcfd7c None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:47.436671 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e36e6-53f9-4782-8408-b897bd21b2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:47.437288 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e36e6-53f9-4782-8408-b897bd21b2f2 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:47.437564 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e36e6-53f9-4782-8408-b897bd21b2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:47.437840 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e36e6-53f9-4782-8408-b897bd21b2f2 None admin] PATH_INFO: `/v3/domains` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:47.438489 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e36e6-53f9-4782-8408-b897bd21b2f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:47.438790 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e36e6-53f9-4782-8408-b897bd21b2f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:47.440199 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e36e6-53f9-4782-8408-b897bd21b2f2 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:47.454004 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 358/728] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:47.464987 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e36e6-53f9-4782-8408-b897bd21b2f2 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:47.549163 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:47.550288 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dd854-1656-4c80-9fc7-ceed41fcfd7c None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:47.582760 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e36e6-53f9-4782-8408-b897bd21b2f2 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:47.594114 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be9d92-5409-43e8-a2da-3bc2ffd2b1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:47.595279 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be9d92-5409-43e8-a2da-3bc2ffd2b1a1 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:47.595802 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be9d92-5409-43e8-a2da-3bc2ffd2b1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:47.596367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be9d92-5409-43e8-a2da-3bc2ffd2b1a1 None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:47.597313 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be9d92-5409-43e8-a2da-3bc2ffd2b1a1 None admin] RBAC: Adding query filter params (name=image) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:47.597946 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be9d92-5409-43e8-a2da-3bc2ffd2b1a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:47.599929 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be9d92-5409-43e8-a2da-3bc2ffd2b1a1 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:47.606003 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 371/729] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:47.615577 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be9d92-5409-43e8-a2da-3bc2ffd2b1a1 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:47.620623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629724a9-86b7-423b-8a7d-1b8357119e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:47.621266 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629724a9-86b7-423b-8a7d-1b8357119e75 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:47.621549 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629724a9-86b7-423b-8a7d-1b8357119e75 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:47.621826 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629724a9-86b7-423b-8a7d-1b8357119e75 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:47.630283 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629724a9-86b7-423b-8a7d-1b8357119e75 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:47.631816 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629724a9-86b7-423b-8a7d-1b8357119e75 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:47.643801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-629724a9-86b7-423b-8a7d-1b8357119e75 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:29:47.643801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:47.643801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:47.643801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:47.643801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:47.643801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:47.643801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:47.643801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:47.643801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:47.643801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:47.643801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:47.643801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:47.643801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:29:47.643801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:29:47.643801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:29:47.643801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:29:47.644749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:47.644749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:47.644749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:29:47.644749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:47.644749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:29:47.644749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:47.644749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:47.644749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:47.644749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:47.644749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:47.644749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:47.644749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:47.644749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:47.644749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:47.644749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:47.644749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:47.644749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:47.644749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:47.645777 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:47.645777 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:47.645777 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:29:47.645777 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:29:47.645777 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:29:47.645777 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:29:47.645777 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:29:47.645777 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:29:47.645777 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:29:47.645777 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:47.645777 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 359/730] 10.222.0.15 () {56 vars in 1093 bytes} [Mon Aug 22 20:29:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:47.645777 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629724a9-86b7-423b-8a7d-1b8357119e75 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:47.694154 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:47.738560 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be9d92-5409-43e8-a2da-3bc2ffd2b1a1 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:47.762555 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629724a9-86b7-423b-8a7d-1b8357119e75 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:47.778810 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04101a-7e7e-4401-8361-7db7a95152c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:47.780148 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04101a-7e7e-4401-8361-7db7a95152c2 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:47.780663 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04101a-7e7e-4401-8361-7db7a95152c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:47.781009 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04101a-7e7e-4401-8361-7db7a95152c2 None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:47.782033 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04101a-7e7e-4401-8361-7db7a95152c2 None admin] RBAC: Adding query filter params (type=image) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:47.782404 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04101a-7e7e-4401-8361-7db7a95152c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:47.783894 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04101a-7e7e-4401-8361-7db7a95152c2 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:47.795769 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 372/731] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:47.795769 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04101a-7e7e-4401-8361-7db7a95152c2 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:47.796503 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:47.800962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0739ff6-4df2-4873-af60-b576f23f0b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:47.801688 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0739ff6-4df2-4873-af60-b576f23f0b47 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:47.802036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0739ff6-4df2-4873-af60-b576f23f0b47 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:47.802385 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0739ff6-4df2-4873-af60-b576f23f0b47 None admin] PATH_INFO: `/v3/services/network` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:47.803088 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0739ff6-4df2-4873-af60-b576f23f0b47 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:47.806893 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0739ff6-4df2-4873-af60-b576f23f0b47 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:47.814200 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-c0739ff6-4df2-4873-af60-b576f23f0b47 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:29:47.814200 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:47.814200 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:29:47.814200 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:29:47.814200 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:29:47.814200 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:29:47.814200 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:29:47.814200 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:47.814200 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:29:47.814200 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:47.814200 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:29:47.814200 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:47.814200 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:47.814200 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:47.814200 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:47.814200 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:47.814200 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:47.815375 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:47.815375 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:47.815375 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:47.815375 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:47.815375 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:47.815375 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:47.815375 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:29:47.815375 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:29:47.815375 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:29:47.815375 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:29:47.815375 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:47.815375 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:47.815375 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:47.815375 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:47.815375 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:47.815375 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:47.816443 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:47.816443 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:47.816443 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:47.816443 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:47.816443 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:47.816443 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:47.816443 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:47.816443 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:47.816443 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:47.816443 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:47.816443 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:29:47.816443 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:47.816443 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:29:47.816443 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:47.817718 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 360/732] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:47 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:47.818552 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0739ff6-4df2-4873-af60-b576f23f0b47 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:47.918566 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04101a-7e7e-4401-8361-7db7a95152c2 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:47.936942 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0739ff6-4df2-4873-af60-b576f23f0b47 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:47.948486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:47.957787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b321b4b-8495-4b91-9c65-33203a3da86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:47.960942 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b321b4b-8495-4b91-9c65-33203a3da86a None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:47.960942 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b321b4b-8495-4b91-9c65-33203a3da86a None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:47.960942 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b321b4b-8495-4b91-9c65-33203a3da86a None admin] PATH_INFO: `/v3/users` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:47.960942 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b321b4b-8495-4b91-9c65-33203a3da86a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:47.960942 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b321b4b-8495-4b91-9c65-33203a3da86a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:47.962765 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b321b4b-8495-4b91-9c65-33203a3da86a None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:47.977538 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4332d-e2a9-4308-a8c2-1f9149cc024d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:47.978237 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4332d-e2a9-4308-a8c2-1f9149cc024d None admin] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:47.978487 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4332d-e2a9-4308-a8c2-1f9149cc024d None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:47.978759 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4332d-e2a9-4308-a8c2-1f9149cc024d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:47.979430 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4332d-e2a9-4308-a8c2-1f9149cc024d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:47.980846 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4332d-e2a9-4308-a8c2-1f9149cc024d None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:47.988415 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 373/733] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Aug 22 20:29:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:47.988415 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b321b4b-8495-4b91-9c65-33203a3da86a None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:48.090361 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b321b4b-8495-4b91-9c65-33203a3da86a None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:48.101201 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 361/734] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 20:29:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:29:48.112880 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4332d-e2a9-4308-a8c2-1f9149cc024d None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:48.142865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d7375-ab66-4630-a573-e8b763c4e392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:48.143091 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d7375-ab66-4630-a573-e8b763c4e392 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:48.143367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d7375-ab66-4630-a573-e8b763c4e392 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:48.143678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d7375-ab66-4630-a573-e8b763c4e392 None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:48.144347 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d7375-ab66-4630-a573-e8b763c4e392 None admin] RBAC: Adding query filter params (name=network) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:48.144638 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d7375-ab66-4630-a573-e8b763c4e392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:48.146165 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d7375-ab66-4630-a573-e8b763c4e392 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:48.156717 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 374/735] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 20:29:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:48.159723 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d7375-ab66-4630-a573-e8b763c4e392 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:48.205255 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:48.227951 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:48.284811 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4332d-e2a9-4308-a8c2-1f9149cc024d None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:48.300583 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d7375-ab66-4630-a573-e8b763c4e392 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:48.350788 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfccb2-4610-4ee9-9dd8-f7ec35a22f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:48.351917 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfccb2-4610-4ee9-9dd8-f7ec35a22f90 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:48.352439 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfccb2-4610-4ee9-9dd8-f7ec35a22f90 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:48.353076 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfccb2-4610-4ee9-9dd8-f7ec35a22f90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:48.354317 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb729e24-2609-4736-98e6-4440f531b490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:48.354951 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb729e24-2609-4736-98e6-4440f531b490 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:48.355260 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb729e24-2609-4736-98e6-4440f531b490 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:48.355533 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb729e24-2609-4736-98e6-4440f531b490 None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:48.356248 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb729e24-2609-4736-98e6-4440f531b490 None admin] RBAC: Adding query filter params (type=network) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:48.356556 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb729e24-2609-4736-98e6-4440f531b490 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:48.358594 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb729e24-2609-4736-98e6-4440f531b490 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:48.364323 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 375/736] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 20:29:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:48.370513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb729e24-2609-4736-98e6-4440f531b490 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:48.454417 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfccb2-4610-4ee9-9dd8-f7ec35a22f90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:48.457190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfccb2-4610-4ee9-9dd8-f7ec35a22f90 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:48.492477 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb729e24-2609-4736-98e6-4440f531b490 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:48.508368 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:48.528636 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:48.542280 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55674b33-1e3e-4add-9289-2ee3875976c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:48.542894 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55674b33-1e3e-4add-9289-2ee3875976c7 None admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:48.543714 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55674b33-1e3e-4add-9289-2ee3875976c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:48.543994 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55674b33-1e3e-4add-9289-2ee3875976c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:48.545354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55674b33-1e3e-4add-9289-2ee3875976c7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:48.548285 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55674b33-1e3e-4add-9289-2ee3875976c7 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:48.579177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 362/737] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:29:48 2022] GET /identity/v3/auth/tokens => generated 1247 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:29:48.580550 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce407d33-c911-4c09-a420-0762157ec589 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:48.580936 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce407d33-c911-4c09-a420-0762157ec589 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:48.581213 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce407d33-c911-4c09-a420-0762157ec589 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:48.582591 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 363/738] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:48.584643 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce407d33-c911-4c09-a420-0762157ec589 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:48.651623 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 376/739] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 20:29:48 2022] POST /identity/v3/endpoints => generated 337 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:29:48.651623 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de29c5d-709a-4f03-84af-2a4485e8c72b None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:48.651623 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de29c5d-709a-4f03-84af-2a4485e8c72b None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:48.651623 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de29c5d-709a-4f03-84af-2a4485e8c72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:48.668456 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-2de29c5d-709a-4f03-84af-2a4485e8c72b None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:48.670867 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-2de29c5d-709a-4f03-84af-2a4485e8c72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:48.726000 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce407d33-c911-4c09-a420-0762157ec589 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:48.768187 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 377/740] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:48 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:29:48.774908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af9d12-b10b-4acb-922c-43b036e1e2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:48.775602 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af9d12-b10b-4acb-922c-43b036e1e2a9 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:48.775943 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af9d12-b10b-4acb-922c-43b036e1e2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:48.776225 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af9d12-b10b-4acb-922c-43b036e1e2a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:48.789039 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af9d12-b10b-4acb-922c-43b036e1e2a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:48.790593 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af9d12-b10b-4acb-922c-43b036e1e2a9 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:48.799400 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:48.809067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-29af9d12-b10b-4acb-922c-43b036e1e2a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:48.809067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:48.809067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:48.809067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:48.809067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:48.809067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:48.809067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:48.809067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:48.809067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:48.809067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:48.809067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:48.809067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:48.809067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:48.809067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:48.809067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:48.809067 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:48.818758 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:48.818758 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:48.818758 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:48.818758 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:48.818758 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:48.818758 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:48.818758 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:48.818758 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:48.818758 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:48.818758 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:48.818758 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:48.818758 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:48.818758 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:48.818758 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:48.818758 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:48.818758 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:48.818758 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:48.819692 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:48.819692 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:48.819692 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:48.819692 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 364/741] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:48.819921 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de29c5d-709a-4f03-84af-2a4485e8c72b None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:48.925598 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:48.932055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de29c5d-709a-4f03-84af-2a4485e8c72b None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:48.971862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24039120-0612-4ec2-b5be-4831a57a10c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:48.972639 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24039120-0612-4ec2-b5be-4831a57a10c9 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:48.972920 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24039120-0612-4ec2-b5be-4831a57a10c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:48.973192 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24039120-0612-4ec2-b5be-4831a57a10c9 None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:48.973848 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24039120-0612-4ec2-b5be-4831a57a10c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:48.974152 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24039120-0612-4ec2-b5be-4831a57a10c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:48.975525 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24039120-0612-4ec2-b5be-4831a57a10c9 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:48.990415 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 378/742] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:48.993845 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af9d12-b10b-4acb-922c-43b036e1e2a9 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:49.097738 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af9d12-b10b-4acb-922c-43b036e1e2a9 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:49.098743 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24039120-0612-4ec2-b5be-4831a57a10c9 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:49.135732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7df5b-91b2-4b40-a3a7-043e90e9834f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:49.136370 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7df5b-91b2-4b40-a3a7-043e90e9834f None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:49.136711 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7df5b-91b2-4b40-a3a7-043e90e9834f None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:49.136985 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7df5b-91b2-4b40-a3a7-043e90e9834f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:49.144826 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7df5b-91b2-4b40-a3a7-043e90e9834f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:49.146515 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7df5b-91b2-4b40-a3a7-043e90e9834f None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:49.159308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-7bc7df5b-91b2-4b40-a3a7-043e90e9834f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:49.159308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:49.159308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:49.159308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:49.159308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:49.159308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:49.159308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:49.159308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:49.159308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:49.159308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:49.159308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:49.159308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:49.159308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:29:49.159308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:29:49.159308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:29:49.160347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:29:49.160347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:49.160347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:49.160347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:49.160347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:49.160347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:49.160347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:49.160347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:49.160347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:49.160347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:49.160347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:49.160347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:49.160347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:49.160347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:49.160347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:49.160347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:49.160347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:49.161259 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:29:49.161259 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:29:49.161259 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:29:49.161259 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:29:49.161259 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:29:49.161259 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:29:49.161259 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:49.161259 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:49.161259 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 365/743] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:49.166284 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7df5b-91b2-4b40-a3a7-043e90e9834f None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:49.206752 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24039120-0612-4ec2-b5be-4831a57a10c9 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:49.230935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:49.247979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65c89b-2f5b-4fb9-80aa-858bb24d9894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:49.247979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65c89b-2f5b-4fb9-80aa-858bb24d9894 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:49.247979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65c89b-2f5b-4fb9-80aa-858bb24d9894 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:49.247979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65c89b-2f5b-4fb9-80aa-858bb24d9894 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:49.248522 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65c89b-2f5b-4fb9-80aa-858bb24d9894 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:49.249847 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65c89b-2f5b-4fb9-80aa-858bb24d9894 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:49.259615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-ca65c89b-2f5b-4fb9-80aa-858bb24d9894 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:29:49.259615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:49.259615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:29:49.259615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:29:49.259615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:29:49.259615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:29:49.259615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:29:49.259615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:49.259615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:29:49.259615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:49.259615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:29:49.259615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:49.259615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:49.259615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:49.259615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:49.259615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:49.259615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:49.260697 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:49.260697 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:49.260697 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:49.260697 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:49.260697 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:49.260697 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:49.260697 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:29:49.260697 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:29:49.260697 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:29:49.260697 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:29:49.260697 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:49.260697 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:49.260697 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:49.260697 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:49.260697 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:49.260697 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:49.261562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:49.261562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:49.261562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:49.261562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:49.261562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:49.261562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:49.261562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:49.261562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:49.261562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:49.261562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:49.261562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:29:49.261562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:49.261562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:29:49.261562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:49.261562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 379/744] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 20:29:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:29:49.267038 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65c89b-2f5b-4fb9-80aa-858bb24d9894 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:49.282187 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7df5b-91b2-4b40-a3a7-043e90e9834f None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:49.291233 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:49.324056 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575c3c4-97af-4772-acdb-d652db68235b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:49.324766 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575c3c4-97af-4772-acdb-d652db68235b None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:49.325119 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575c3c4-97af-4772-acdb-d652db68235b None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:49.325399 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575c3c4-97af-4772-acdb-d652db68235b None admin] PATH_INFO: `/v3/projects` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:49.326225 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575c3c4-97af-4772-acdb-d652db68235b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:49.326530 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575c3c4-97af-4772-acdb-d652db68235b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:49.328075 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575c3c4-97af-4772-acdb-d652db68235b None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:49.340622 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 366/745] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 20:29:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:49.347153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575c3c4-97af-4772-acdb-d652db68235b None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:49.384196 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65c89b-2f5b-4fb9-80aa-858bb24d9894 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:49.429372 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50134dfc-c68d-415f-afa1-c78d11e07d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:49.429991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50134dfc-c68d-415f-afa1-c78d11e07d4c None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:49.430272 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50134dfc-c68d-415f-afa1-c78d11e07d4c None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:49.430545 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50134dfc-c68d-415f-afa1-c78d11e07d4c None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:49.431178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50134dfc-c68d-415f-afa1-c78d11e07d4c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:49.431484 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50134dfc-c68d-415f-afa1-c78d11e07d4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:49.432888 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50134dfc-c68d-415f-afa1-c78d11e07d4c None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:49.439380 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 380/746] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 20:29:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:49.444868 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50134dfc-c68d-415f-afa1-c78d11e07d4c None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:49.465362 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575c3c4-97af-4772-acdb-d652db68235b None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:49.484721 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:49.506514 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1dc8d-9274-4ee7-a4bc-f8f8e97ded75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:49.507504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1dc8d-9274-4ee7-a4bc-f8f8e97ded75 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:49.507981 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1dc8d-9274-4ee7-a4bc-f8f8e97ded75 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:49.508253 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1dc8d-9274-4ee7-a4bc-f8f8e97ded75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:49.508974 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1dc8d-9274-4ee7-a4bc-f8f8e97ded75 None admin] RBAC: Adding query filter params (role.id=1e3ce9c8b9934a7bb515b39e21fc1d68, scope.project.id=7bda5c44ace24608b8ca69e9059d73ef, user.id=c18d1768fb7a4bac93b28d095b74caf6) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:49.509278 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1dc8d-9274-4ee7-a4bc-f8f8e97ded75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:49.510711 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1dc8d-9274-4ee7-a4bc-f8f8e97ded75 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:49.523605 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 367/747] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:29:49 2022] GET /identity/v3/role_assignments?user.id=c18d1768fb7a4bac93b28d095b74caf6&scope.project.id=7bda5c44ace24608b8ca69e9059d73ef&role.id=1e3ce9c8b9934a7bb515b39e21fc1d68 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:49.542497 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:49.560280 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50134dfc-c68d-415f-afa1-c78d11e07d4c None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:49.600039 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac238a-1ced-42db-bb28-900ed23ff148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:49.600672 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac238a-1ced-42db-bb28-900ed23ff148 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:49.600970 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac238a-1ced-42db-bb28-900ed23ff148 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:49.601246 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac238a-1ced-42db-bb28-900ed23ff148 None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:49.601903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac238a-1ced-42db-bb28-900ed23ff148 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:49.602206 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac238a-1ced-42db-bb28-900ed23ff148 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:49.603661 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac238a-1ced-42db-bb28-900ed23ff148 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:49.609055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 381/748] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 20:29:49 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:50.404070 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b6cf4-e963-443d-a595-57a7843c9fa7 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:50.404601 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b6cf4-e963-443d-a595-57a7843c9fa7 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:50.404707 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b6cf4-e963-443d-a595-57a7843c9fa7 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:50.406005 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 368/749] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:50.411304 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675b391-9380-4ca7-99c8-af10e2b1da0c None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:50.411704 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675b391-9380-4ca7-99c8-af10e2b1da0c None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:50.411894 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675b391-9380-4ca7-99c8-af10e2b1da0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:50.430159 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-8675b391-9380-4ca7-99c8-af10e2b1da0c None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:50.431346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-8675b391-9380-4ca7-99c8-af10e2b1da0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:50.502533 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 382/750] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:50 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:29:50.830960 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b6cf4-e963-443d-a595-57a7843c9fa7 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:50.941065 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b6cf4-e963-443d-a595-57a7843c9fa7 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:50.992426 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbbeb7-87e0-43ab-96d9-3345c63f545b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:50.993040 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbbeb7-87e0-43ab-96d9-3345c63f545b None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:50.993324 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbbeb7-87e0-43ab-96d9-3345c63f545b None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:50.993596 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbbeb7-87e0-43ab-96d9-3345c63f545b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:51.047967 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:51.067764 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbbeb7-87e0-43ab-96d9-3345c63f545b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:51.069236 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbbeb7-87e0-43ab-96d9-3345c63f545b None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:51.183696 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 369/751] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:29:50 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:29:51.187654 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675b391-9380-4ca7-99c8-af10e2b1da0c None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:51.278488 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:51.300908 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675b391-9380-4ca7-99c8-af10e2b1da0c None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:51.336458 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcb367-9247-410f-8d74-dd8ae83839ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:51.337093 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcb367-9247-410f-8d74-dd8ae83839ea None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:51.337372 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcb367-9247-410f-8d74-dd8ae83839ea None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:51.337645 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcb367-9247-410f-8d74-dd8ae83839ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:51.348972 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcb367-9247-410f-8d74-dd8ae83839ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:51.350431 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcb367-9247-410f-8d74-dd8ae83839ea None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:51.366835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-87bcb367-9247-410f-8d74-dd8ae83839ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:51.366835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:51.366835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:51.366835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:51.366835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:51.366835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:51.366835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:51.366835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:51.366835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:51.366835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:51.366835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:51.366835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:51.366835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:51.366835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:51.366835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:51.366835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:51.368232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:51.368232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:51.368232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:51.368232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:51.368232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:51.368232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:51.368232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:51.368232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:51.368232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:51.368232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:51.368232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:51.368232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:51.368232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:51.368232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:51.368232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:51.368232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:51.368232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:51.369147 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:51.369147 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:51.369147 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:51.373756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 383/752] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:51.375268 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbbeb7-87e0-43ab-96d9-3345c63f545b None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:51.469032 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:51.490070 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbbeb7-87e0-43ab-96d9-3345c63f545b None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:51.545994 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6ba99-6f32-43b8-ab45-92f44cec3770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:51.546613 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6ba99-6f32-43b8-ab45-92f44cec3770 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:51.546891 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6ba99-6f32-43b8-ab45-92f44cec3770 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:51.547164 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6ba99-6f32-43b8-ab45-92f44cec3770 None admin] PATH_INFO: `/v3/domains` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:51.547851 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6ba99-6f32-43b8-ab45-92f44cec3770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:51.548156 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6ba99-6f32-43b8-ab45-92f44cec3770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:51.549540 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6ba99-6f32-43b8-ab45-92f44cec3770 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:51.562705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 370/753] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:51.809078 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b41d17-94aa-4ad5-a3cd-d3fe4185f202 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:51.809621 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b41d17-94aa-4ad5-a3cd-d3fe4185f202 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:51.809621 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b41d17-94aa-4ad5-a3cd-d3fe4185f202 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:51.812071 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 384/754] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:51.817575 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc419a75-2798-4df4-93b5-aeaeb69f9c90 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:51.817866 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc419a75-2798-4df4-93b5-aeaeb69f9c90 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:51.818145 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc419a75-2798-4df4-93b5-aeaeb69f9c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:51.837827 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-bc419a75-2798-4df4-93b5-aeaeb69f9c90 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:51.839032 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-bc419a75-2798-4df4-93b5-aeaeb69f9c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:51.852875 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a866c-7787-403c-b7ad-1d81fa5b3514 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:51.853166 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a866c-7787-403c-b7ad-1d81fa5b3514 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:51.853465 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a866c-7787-403c-b7ad-1d81fa5b3514 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:51.854786 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 385/755] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:51.860827 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2bb9c-4301-40ee-bdb3-bb2a3234d730 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:51.861114 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2bb9c-4301-40ee-bdb3-bb2a3234d730 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:51.861392 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2bb9c-4301-40ee-bdb3-bb2a3234d730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:51.881187 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-e8f2bb9c-4301-40ee-bdb3-bb2a3234d730 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:51.882418 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-e8f2bb9c-4301-40ee-bdb3-bb2a3234d730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:51.918451 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 371/756] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:51 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:29:51.954140 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 386/757] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:51 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:29:52.242994 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc419a75-2798-4df4-93b5-aeaeb69f9c90 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:52.275443 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2bb9c-4301-40ee-bdb3-bb2a3234d730 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:52.312182 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:52.334269 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:52.342825 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc419a75-2798-4df4-93b5-aeaeb69f9c90 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:52.377121 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc903df-d0ab-4cd2-8dfe-f24d32bd2e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:52.377484 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2bb9c-4301-40ee-bdb3-bb2a3234d730 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:52.377757 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc903df-d0ab-4cd2-8dfe-f24d32bd2e5a None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:52.378030 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc903df-d0ab-4cd2-8dfe-f24d32bd2e5a None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:52.378298 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc903df-d0ab-4cd2-8dfe-f24d32bd2e5a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:52.378875 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc903df-d0ab-4cd2-8dfe-f24d32bd2e5a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:52.380268 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc903df-d0ab-4cd2-8dfe-f24d32bd2e5a None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:52.389062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-5bc903df-d0ab-4cd2-8dfe-f24d32bd2e5a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:29:52.389062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:52.389062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:29:52.389062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:29:52.389062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:29:52.389062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:29:52.389062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:29:52.389062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:52.389062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:29:52.389062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:52.389062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:29:52.389062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:52.389062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:52.389062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:52.389062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:52.389062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:52.390263 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:52.390263 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:52.390263 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:52.390263 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:52.390263 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:52.390263 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:52.390263 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:52.390263 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:29:52.390263 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:29:52.390263 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:29:52.390263 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:29:52.390263 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:52.390263 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:52.390263 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:52.390263 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:52.390263 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:52.390263 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:52.391243 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:52.391243 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:52.391243 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:52.391243 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:52.391243 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:52.391243 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:52.391243 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:52.391243 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:52.391243 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:52.391243 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:52.391243 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:29:52.391243 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:52.391243 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:29:52.391243 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:52.391243 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 372/758] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Aug 22 20:29:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:52.395940 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc903df-d0ab-4cd2-8dfe-f24d32bd2e5a None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:52.412837 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942babf-381d-49b5-a1ae-bc6c51cdbafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:52.413446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942babf-381d-49b5-a1ae-bc6c51cdbafb None admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:52.413720 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942babf-381d-49b5-a1ae-bc6c51cdbafb None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:52.413988 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942babf-381d-49b5-a1ae-bc6c51cdbafb None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:52.414627 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942babf-381d-49b5-a1ae-bc6c51cdbafb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:52.416032 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942babf-381d-49b5-a1ae-bc6c51cdbafb None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:52.490952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 387/759] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 20:29:52 2022] POST /identity/v3/services => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:29:52.497182 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc903df-d0ab-4cd2-8dfe-f24d32bd2e5a None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:52.541205 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:52.546778 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cbb21-29ee-491d-af32-0931ecd6300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:52.547422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cbb21-29ee-491d-af32-0931ecd6300c None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:52.547737 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cbb21-29ee-491d-af32-0931ecd6300c None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:52.548007 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cbb21-29ee-491d-af32-0931ecd6300c None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:52.548644 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716cbb21-29ee-491d-af32-0931ecd6300c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:52.548970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716cbb21-29ee-491d-af32-0931ecd6300c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:52.550445 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716cbb21-29ee-491d-af32-0931ecd6300c None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:52.555878 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 373/760] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Aug 22 20:29:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:52.562663 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942babf-381d-49b5-a1ae-bc6c51cdbafb None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:52.669245 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942babf-381d-49b5-a1ae-bc6c51cdbafb None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:52.690048 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:52.706049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a6476-e0c8-4022-8527-ecb809deaa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:52.706659 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a6476-e0c8-4022-8527-ecb809deaa25 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:52.706941 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a6476-e0c8-4022-8527-ecb809deaa25 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:52.707217 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a6476-e0c8-4022-8527-ecb809deaa25 None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:52.707910 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a6476-e0c8-4022-8527-ecb809deaa25 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:52.708212 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a6476-e0c8-4022-8527-ecb809deaa25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:52.709594 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a6476-e0c8-4022-8527-ecb809deaa25 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:52.714288 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 388/761] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Aug 22 20:29:52 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:54.750224 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7e347-c7c4-4108-a12f-6904014f03e6 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:54.750799 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7e347-c7c4-4108-a12f-6904014f03e6 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:54.750799 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7e347-c7c4-4108-a12f-6904014f03e6 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:54.752252 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 374/762] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:54.758308 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3549cf-424f-4ee3-a765-7b19d68ef06d None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:54.758843 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3549cf-424f-4ee3-a765-7b19d68ef06d None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:54.759016 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3549cf-424f-4ee3-a765-7b19d68ef06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:54.778278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-7a3549cf-424f-4ee3-a765-7b19d68ef06d None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:54.793056 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-7a3549cf-424f-4ee3-a765-7b19d68ef06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:54.853399 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 389/763] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:54 2022] POST /identity/v3/auth/tokens => generated 1507 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:29:54.890335 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43b715-d847-44c0-841e-07b5ce13d9c7 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:54.890715 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43b715-d847-44c0-841e-07b5ce13d9c7 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:54.890991 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43b715-d847-44c0-841e-07b5ce13d9c7 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:54.892356 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 375/764] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:54.898565 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be705e-565f-411b-98c8-c500bf8ef3ea None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:54.898856 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be705e-565f-411b-98c8-c500bf8ef3ea None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:54.899137 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be705e-565f-411b-98c8-c500bf8ef3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:54.918115 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-40be705e-565f-411b-98c8-c500bf8ef3ea None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:54.919302 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-40be705e-565f-411b-98c8-c500bf8ef3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:54.986250 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 390/765] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:54 2022] POST /identity/v3/auth/tokens => generated 1507 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:29:55.183259 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43b715-d847-44c0-841e-07b5ce13d9c7 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:55.284061 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43b715-d847-44c0-841e-07b5ce13d9c7 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:55.307570 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be705e-565f-411b-98c8-c500bf8ef3ea None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:55.317580 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1869dd-2f99-4713-a854-6fca8ca6fcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:55.318206 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1869dd-2f99-4713-a854-6fca8ca6fcf2 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:55.318480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1869dd-2f99-4713-a854-6fca8ca6fcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:55.318752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1869dd-2f99-4713-a854-6fca8ca6fcf2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:55.319334 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1869dd-2f99-4713-a854-6fca8ca6fcf2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:55.320747 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1869dd-2f99-4713-a854-6fca8ca6fcf2 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:55.329365 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-6a1869dd-2f99-4713-a854-6fca8ca6fcf2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:29:55.329365 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:55.329365 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:29:55.329365 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:29:55.329365 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:29:55.329365 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:29:55.329365 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:29:55.329365 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:55.329365 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:29:55.329365 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:55.329365 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:29:55.329365 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:55.329365 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:55.329365 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:55.329365 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:55.329365 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:55.329365 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:55.330360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:55.330360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:55.330360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:55.330360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:55.330360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:55.330360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:55.330360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:29:55.330360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:29:55.330360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:29:55.330360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:29:55.330360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:55.330360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:55.330360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:55.330360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:55.330360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:55.330360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:55.331508 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:55.331508 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:55.331508 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:55.331508 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:55.331508 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:55.331508 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:55.331508 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:55.331508 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:55.331508 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:55.331508 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:55.331508 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:29:55.331508 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:55.331508 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:29:55.331508 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:55.331508 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 376/766] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 20:29:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:55.336197 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1869dd-2f99-4713-a854-6fca8ca6fcf2 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:55.352885 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:55.396169 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:55.405771 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be705e-565f-411b-98c8-c500bf8ef3ea None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:55.437597 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1869dd-2f99-4713-a854-6fca8ca6fcf2 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:55.440946 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90984832-7464-449a-b9fd-c7b35035358b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:55.441558 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90984832-7464-449a-b9fd-c7b35035358b None admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:55.441834 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90984832-7464-449a-b9fd-c7b35035358b None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:55.442108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90984832-7464-449a-b9fd-c7b35035358b None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:55.442753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90984832-7464-449a-b9fd-c7b35035358b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:55.444164 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90984832-7464-449a-b9fd-c7b35035358b None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:55.472319 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8dba24-0910-45ca-b00d-4352438b05f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:55.472913 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dba24-0910-45ca-b00d-4352438b05f6 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:55.473191 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dba24-0910-45ca-b00d-4352438b05f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:55.473464 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dba24-0910-45ca-b00d-4352438b05f6 None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:55.474085 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8dba24-0910-45ca-b00d-4352438b05f6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:55.474385 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8dba24-0910-45ca-b00d-4352438b05f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:55.475777 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8dba24-0910-45ca-b00d-4352438b05f6 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:55.480186 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 377/767] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 20:29:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:55.485767 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8dba24-0910-45ca-b00d-4352438b05f6 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:55.525282 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 391/768] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 20:29:55 2022] POST /identity/v3/services => generated 269 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:29:55.593839 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8dba24-0910-45ca-b00d-4352438b05f6 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:55.620212 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:55.636930 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56deac-a164-4d62-8de4-f7a4ef62cc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:55.637857 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56deac-a164-4d62-8de4-f7a4ef62cc38 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:55.638143 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56deac-a164-4d62-8de4-f7a4ef62cc38 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:55.639026 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56deac-a164-4d62-8de4-f7a4ef62cc38 None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:55.639700 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56deac-a164-4d62-8de4-f7a4ef62cc38 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:55.640011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56deac-a164-4d62-8de4-f7a4ef62cc38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:55.641743 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56deac-a164-4d62-8de4-f7a4ef62cc38 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:55.647360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 378/769] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 20:29:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:55.653686 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90984832-7464-449a-b9fd-c7b35035358b None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:55.759762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90984832-7464-449a-b9fd-c7b35035358b None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:55.762158 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:55.794130 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200da2d-89ff-4d28-88b5-15966ecb7869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:55.794773 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200da2d-89ff-4d28-88b5-15966ecb7869 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:55.795053 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200da2d-89ff-4d28-88b5-15966ecb7869 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:55.795326 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200da2d-89ff-4d28-88b5-15966ecb7869 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:55.796072 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200da2d-89ff-4d28-88b5-15966ecb7869 None admin] RBAC: Adding query filter params (interface=public, service_id=a2d8bb98739f4120b013351f096b25ff, region_id=RegionOne) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:55.796387 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200da2d-89ff-4d28-88b5-15966ecb7869 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:55.797766 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200da2d-89ff-4d28-88b5-15966ecb7869 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:55.802700 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 392/770] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Aug 22 20:29:55 2022] GET /identity/v3/endpoints?service_id=a2d8bb98739f4120b013351f096b25ff&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:55.808573 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56deac-a164-4d62-8de4-f7a4ef62cc38 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:55.909295 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56deac-a164-4d62-8de4-f7a4ef62cc38 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:55.942590 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d914252-12ce-4764-b10c-0a003853a8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:55.943196 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d914252-12ce-4764-b10c-0a003853a8be None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:55.943472 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d914252-12ce-4764-b10c-0a003853a8be None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:55.943771 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d914252-12ce-4764-b10c-0a003853a8be None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:55.944368 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d914252-12ce-4764-b10c-0a003853a8be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:55.945731 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d914252-12ce-4764-b10c-0a003853a8be None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:55.952008 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 379/771] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Aug 22 20:29:55 2022] GET /identity/v3/services => generated 1498 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:29:57.749174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79e4d3-2dd1-41e8-9a58-1ad04b37e9cc None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:57.749711 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79e4d3-2dd1-41e8-9a58-1ad04b37e9cc None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:57.749711 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79e4d3-2dd1-41e8-9a58-1ad04b37e9cc None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:57.751091 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 393/772] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:57.757537 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d3980-1ff9-4944-99ba-c1ab837062f0 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:57.758018 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d3980-1ff9-4944-99ba-c1ab837062f0 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:57.758208 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d3980-1ff9-4944-99ba-c1ab837062f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:57.776676 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-934d3980-1ff9-4944-99ba-c1ab837062f0 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:57.777880 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-934d3980-1ff9-4944-99ba-c1ab837062f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:57.826197 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:57.848667 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 380/773] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:57 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:29:58.151217 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001a1bc-8be0-464e-bd58-d045d54faf69 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:58.151400 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001a1bc-8be0-464e-bd58-d045d54faf69 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:58.151704 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001a1bc-8be0-464e-bd58-d045d54faf69 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:58.153065 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 394/774] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:58.158841 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81734d0-8760-4dfd-abfd-d8160250bdf6 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:58.159130 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81734d0-8760-4dfd-abfd-d8160250bdf6 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:58.159423 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81734d0-8760-4dfd-abfd-d8160250bdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:58.177936 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-f81734d0-8760-4dfd-abfd-d8160250bdf6 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:58.179134 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-f81734d0-8760-4dfd-abfd-d8160250bdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:58.179795 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001a1bc-8be0-464e-bd58-d045d54faf69 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:58.248676 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 381/775] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:58 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:29:58.285133 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001a1bc-8be0-464e-bd58-d045d54faf69 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:58.319072 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f32010-f405-4bd7-8982-5ba575aaf782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:58.319720 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f32010-f405-4bd7-8982-5ba575aaf782 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:58.320000 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f32010-f405-4bd7-8982-5ba575aaf782 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:58.320271 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f32010-f405-4bd7-8982-5ba575aaf782 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:58.320849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f32010-f405-4bd7-8982-5ba575aaf782 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:58.322208 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f32010-f405-4bd7-8982-5ba575aaf782 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:58.330662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-78f32010-f405-4bd7-8982-5ba575aaf782 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:29:58.330662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:58.330662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:29:58.330662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:29:58.330662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:29:58.330662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:29:58.330662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:29:58.330662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:58.330662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:29:58.330662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:58.330662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:29:58.330662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:58.330662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:58.330662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:58.330662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:58.330662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:58.331585 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:58.331585 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:58.331585 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:58.331585 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:58.331585 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:58.331585 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:58.331585 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:58.331585 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:29:58.331585 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:29:58.331585 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:29:58.331585 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:29:58.331585 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:58.331585 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:58.331585 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:58.331585 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:58.331585 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:58.331585 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:58.332480 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:58.332480 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:58.332480 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:58.332480 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:58.332480 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:58.332480 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:58.332480 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:58.332480 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:58.332480 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:58.332480 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:58.332480 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:29:58.332480 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:58.332480 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:29:58.332480 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:29:58.332480 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 395/776] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Aug 22 20:29:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:29:58.337648 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81734d0-8760-4dfd-abfd-d8160250bdf6 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:58.434916 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81734d0-8760-4dfd-abfd-d8160250bdf6 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:58.444177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:58.468765 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9310ae-5b92-4d41-ae44-7577f4f176ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:58.472302 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9310ae-5b92-4d41-ae44-7577f4f176ef None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:58.472302 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9310ae-5b92-4d41-ae44-7577f4f176ef None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:58.472302 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9310ae-5b92-4d41-ae44-7577f4f176ef None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:58.472302 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9310ae-5b92-4d41-ae44-7577f4f176ef None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:58.472302 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9310ae-5b92-4d41-ae44-7577f4f176ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:58.472302 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9310ae-5b92-4d41-ae44-7577f4f176ef None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:58.476961 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 382/777] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Aug 22 20:29:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:58.483209 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f32010-f405-4bd7-8982-5ba575aaf782 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:58.516081 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:58.575058 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9310ae-5b92-4d41-ae44-7577f4f176ef None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:58.590178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f32010-f405-4bd7-8982-5ba575aaf782 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:58.625487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16427f96-f475-4ce9-8fc6-96f63b2dea07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:58.626096 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16427f96-f475-4ce9-8fc6-96f63b2dea07 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:58.626373 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16427f96-f475-4ce9-8fc6-96f63b2dea07 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:58.626646 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16427f96-f475-4ce9-8fc6-96f63b2dea07 None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:58.627277 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16427f96-f475-4ce9-8fc6-96f63b2dea07 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:58.627609 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16427f96-f475-4ce9-8fc6-96f63b2dea07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:58.628985 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16427f96-f475-4ce9-8fc6-96f63b2dea07 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:58.636947 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 396/778] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Aug 22 20:29:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:58.643043 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16427f96-f475-4ce9-8fc6-96f63b2dea07 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:58.677869 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9310ae-5b92-4d41-ae44-7577f4f176ef None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:58.713807 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438cf33-63ce-47bc-b71a-ca62d4958755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:58.714388 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438cf33-63ce-47bc-b71a-ca62d4958755 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:58.714670 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438cf33-63ce-47bc-b71a-ca62d4958755 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:58.714951 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438cf33-63ce-47bc-b71a-ca62d4958755 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:58.715556 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438cf33-63ce-47bc-b71a-ca62d4958755 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:58.716940 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438cf33-63ce-47bc-b71a-ca62d4958755 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:58.725582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-b438cf33-63ce-47bc-b71a-ca62d4958755 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:29:58.725582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:58.725582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:29:58.725582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:29:58.725582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:29:58.725582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:29:58.725582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:29:58.725582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:58.725582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:29:58.725582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:58.725582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:29:58.725582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:58.725582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:58.725582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:58.725582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:58.725582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:58.725582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:58.726796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:58.726796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:58.726796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:58.726796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:58.726796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:58.726796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:58.726796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:29:58.726796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:29:58.726796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:29:58.726796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:29:58.726796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:58.726796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:58.726796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:58.726796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:58.726796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:58.726796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:58.727695 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:58.727695 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:58.727695 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:58.727695 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:58.727695 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:58.727695 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:58.727695 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:58.727695 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:58.727695 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:58.727695 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:58.727695 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:29:58.727695 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:29:58.727695 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:29:58.727695 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:29:58.727695 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 383/779] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 20:29:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:58.733160 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438cf33-63ce-47bc-b71a-ca62d4958755 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:58.744732 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:58.750929 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16427f96-f475-4ce9-8fc6-96f63b2dea07 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:58.774354 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:58.786391 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597d672-1d96-48b0-a2a3-805dee7edfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:58.786998 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597d672-1d96-48b0-a2a3-805dee7edfa2 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:58.787278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597d672-1d96-48b0-a2a3-805dee7edfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:58.787571 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597d672-1d96-48b0-a2a3-805dee7edfa2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:58.788274 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597d672-1d96-48b0-a2a3-805dee7edfa2 None admin] RBAC: Adding query filter params (interface=public, service_id=8bf1ca4582bc49a6b2868733d99865eb, region_id=RegionOne) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:58.788584 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597d672-1d96-48b0-a2a3-805dee7edfa2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:58.789950 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597d672-1d96-48b0-a2a3-805dee7edfa2 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:58.795371 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 397/780] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Aug 22 20:29:58 2022] GET /identity/v3/endpoints?service_id=8bf1ca4582bc49a6b2868733d99865eb&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:58.800874 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597d672-1d96-48b0-a2a3-805dee7edfa2 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:58.839253 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438cf33-63ce-47bc-b71a-ca62d4958755 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:58.873604 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0026fe2-f71d-4566-8a54-0e7b33029885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:58.874207 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0026fe2-f71d-4566-8a54-0e7b33029885 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:58.874487 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0026fe2-f71d-4566-8a54-0e7b33029885 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:58.874761 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0026fe2-f71d-4566-8a54-0e7b33029885 None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:58.875396 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0026fe2-f71d-4566-8a54-0e7b33029885 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:58.875738 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0026fe2-f71d-4566-8a54-0e7b33029885 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:58.877114 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0026fe2-f71d-4566-8a54-0e7b33029885 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:58.881714 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 384/781] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 20:29:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:58.887287 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0026fe2-f71d-4566-8a54-0e7b33029885 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:58.899671 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597d672-1d96-48b0-a2a3-805dee7edfa2 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:58.934762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d9970-066e-416f-8ccf-bc477bfafb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:58.935370 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d9970-066e-416f-8ccf-bc477bfafb7d None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:58.935689 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d9970-066e-416f-8ccf-bc477bfafb7d None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:58.936498 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d9970-066e-416f-8ccf-bc477bfafb7d None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:58.937110 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d9970-066e-416f-8ccf-bc477bfafb7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:58.938478 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d9970-066e-416f-8ccf-bc477bfafb7d None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:58.944855 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 398/782] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Aug 22 20:29:58 2022] GET /identity/v3/services => generated 1498 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:29:58.989119 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:58.992462 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0026fe2-f71d-4566-8a54-0e7b33029885 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:59.031352 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048944d-e7d3-4a4e-909f-d240fc97801f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:59.032113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048944d-e7d3-4a4e-909f-d240fc97801f None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:59.032390 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048944d-e7d3-4a4e-909f-d240fc97801f None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:59.032664 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048944d-e7d3-4a4e-909f-d240fc97801f None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:59.033345 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048944d-e7d3-4a4e-909f-d240fc97801f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:59.033649 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048944d-e7d3-4a4e-909f-d240fc97801f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:59.035095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048944d-e7d3-4a4e-909f-d240fc97801f None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:59.041237 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 385/783] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 20:29:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:59.048085 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d9970-066e-416f-8ccf-bc477bfafb7d None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:59.075085 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:59.154608 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d9970-066e-416f-8ccf-bc477bfafb7d None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:59.189725 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c85ea-d912-47ad-a9b2-5568f9840b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:59.190331 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c85ea-d912-47ad-a9b2-5568f9840b37 None admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:59.190610 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c85ea-d912-47ad-a9b2-5568f9840b37 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:59.190885 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c85ea-d912-47ad-a9b2-5568f9840b37 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:59.191580 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c85ea-d912-47ad-a9b2-5568f9840b37 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:59.192978 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c85ea-d912-47ad-a9b2-5568f9840b37 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:59.280338 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 399/784] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 20:29:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:30:01.142650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083e99f-cace-466a-867f-c2d272d0583c None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:01.143184 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083e99f-cace-466a-867f-c2d272d0583c None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:01.143184 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083e99f-cace-466a-867f-c2d272d0583c None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:01.144722 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 386/785] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:30:01.150179 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8664bc-5df3-4991-8f4f-11e6a2eec87b None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:01.150649 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8664bc-5df3-4991-8f4f-11e6a2eec87b None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:01.150799 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8664bc-5df3-4991-8f4f-11e6a2eec87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:01.169401 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-7a8664bc-5df3-4991-8f4f-11e6a2eec87b None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:30:01.171245 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-7a8664bc-5df3-4991-8f4f-11e6a2eec87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:30:01.250426 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 400/786] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:30:01 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:30:01.501301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a0d3d-83dc-46d1-9b9a-9f9a42126ce4 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:01.501498 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a0d3d-83dc-46d1-9b9a-9f9a42126ce4 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:01.501770 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a0d3d-83dc-46d1-9b9a-9f9a42126ce4 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:01.503100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 387/787] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:30:01.508630 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca89cb-39d0-488e-8255-7e0105d5fd16 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:01.508914 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca89cb-39d0-488e-8255-7e0105d5fd16 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:01.509184 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca89cb-39d0-488e-8255-7e0105d5fd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:01.521958 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:01.531238 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-aeca89cb-39d0-488e-8255-7e0105d5fd16 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:30:01.532503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-aeca89cb-39d0-488e-8255-7e0105d5fd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:30:01.579831 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a0d3d-83dc-46d1-9b9a-9f9a42126ce4 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:01.599472 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 401/788] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:30:01 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:30:01.682134 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a0d3d-83dc-46d1-9b9a-9f9a42126ce4 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:01.716883 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29c7e0-450e-4cee-8f9e-ff649ae364ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:01.717969 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29c7e0-450e-4cee-8f9e-ff649ae364ec None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:01.718464 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29c7e0-450e-4cee-8f9e-ff649ae364ec None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:01.718958 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29c7e0-450e-4cee-8f9e-ff649ae364ec None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:01.720054 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29c7e0-450e-4cee-8f9e-ff649ae364ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:01.722376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29c7e0-450e-4cee-8f9e-ff649ae364ec None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:01.731223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-6b29c7e0-450e-4cee-8f9e-ff649ae364ec None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:30:01.731223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:01.731223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:30:01.731223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:30:01.731223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:30:01.731223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:30:01.731223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:30:01.731223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:30:01.731223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:30:01.731223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:30:01.731223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:30:01.731223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:30:01.731223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:01.731223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:30:01.731223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:30:01.731223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:30:01.732294 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:30:01.732294 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:30:01.732294 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:30:01.732294 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:30:01.732294 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:30:01.732294 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:30:01.732294 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:30:01.732294 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:30:01.732294 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:30:01.732294 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:30:01.732294 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:30:01.732294 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:30:01.732294 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:30:01.732294 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:30:01.732294 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:30:01.732294 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:30:01.732294 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:30:01.733359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:30:01.733359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:30:01.733359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:30:01.733359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:30:01.733359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:30:01.733359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:30:01.733359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:30:01.733359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:30:01.733359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:30:01.733359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:30:01.733359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:30:01.733359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:30:01.733359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:30:01.733359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:30:01.733359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 388/789] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Aug 22 20:30:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:30:01.738591 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca89cb-39d0-488e-8255-7e0105d5fd16 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:01.840004 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca89cb-39d0-488e-8255-7e0105d5fd16 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:01.874429 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800c932-78d3-4f79-aaba-5c4e6493634b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:01.875036 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800c932-78d3-4f79-aaba-5c4e6493634b None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:01.875387 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800c932-78d3-4f79-aaba-5c4e6493634b None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:01.878667 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800c932-78d3-4f79-aaba-5c4e6493634b None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:01.879314 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800c932-78d3-4f79-aaba-5c4e6493634b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:01.884146 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800c932-78d3-4f79-aaba-5c4e6493634b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:01.885592 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800c932-78d3-4f79-aaba-5c4e6493634b None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:01.888265 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:01.893505 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 402/790] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Aug 22 20:30:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:01.899406 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29c7e0-450e-4cee-8f9e-ff649ae364ec None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:01.927936 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:01.929511 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800c932-78d3-4f79-aaba-5c4e6493634b None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:02.001843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29c7e0-450e-4cee-8f9e-ff649ae364ec None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:02.032425 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800c932-78d3-4f79-aaba-5c4e6493634b None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:02.037044 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dc54f-1025-40e7-84a3-03f96e0b764a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:02.037646 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dc54f-1025-40e7-84a3-03f96e0b764a None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:02.037921 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dc54f-1025-40e7-84a3-03f96e0b764a None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:02.038191 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dc54f-1025-40e7-84a3-03f96e0b764a None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:02.038811 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2dc54f-1025-40e7-84a3-03f96e0b764a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:02.039109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2dc54f-1025-40e7-84a3-03f96e0b764a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:02.040561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2dc54f-1025-40e7-84a3-03f96e0b764a None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:02.045474 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 389/791] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Aug 22 20:30:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:02.051315 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dc54f-1025-40e7-84a3-03f96e0b764a None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:02.069852 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc8d0b-5a2e-449d-aba1-91baf224c0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:02.070379 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc8d0b-5a2e-449d-aba1-91baf224c0a4 None admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:02.070677 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc8d0b-5a2e-449d-aba1-91baf224c0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:02.070951 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc8d0b-5a2e-449d-aba1-91baf224c0a4 None admin] PATH_INFO: `/v3/projects` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:02.071621 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc8d0b-5a2e-449d-aba1-91baf224c0a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:02.073069 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc8d0b-5a2e-449d-aba1-91baf224c0a4 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:02.075768 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: WARNING keystone.server.flask.common [None req-5bbc8d0b-5a2e-449d-aba1-91baf224c0a4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 22 20:30:02.124919 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.sql.core [None req-5bbc8d0b-5a2e-449d-aba1-91baf224c0a4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 20:30:02.124919 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 20:30:02.124919 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [parameters: {'id': 'b24971109fec4010a369e4e5caae4d10', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 20:30:02.124919 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88640) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 20:30:02.142093 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-5bbc8d0b-5a2e-449d-aba1-91baf224c0a4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b24971109fec4010a369e4e5caae4d10.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b24971109fec4010a369e4e5caae4d10. Aug 22 20:30:02.142093 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:02.142093 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 20:30:02.142093 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 20:30:02.142093 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 20:30:02.142093 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 20:30:02.142093 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 20:30:02.142093 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 20:30:02.142093 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 20:30:02.142093 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application conn.query(q) Aug 22 20:30:02.142093 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 20:30:02.142093 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 20:30:02.142093 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 20:30:02.143174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application result.read() Aug 22 20:30:02.143174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 20:30:02.143174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 20:30:02.143174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 20:30:02.143174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 20:30:02.143174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 20:30:02.143174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 20:30:02.143174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 20:30:02.143174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 20:30:02.143174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 20:30:02.143174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:30:02.143174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 20:30:02.143174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:30:02.143174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:02.143174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 20:30:02.143174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 20:30:02.143174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 22 20:30:02.143174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 22 20:30:02.144312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 20:30:02.144312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application next(self.gen) Aug 22 20:30:02.144312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 20:30:02.144312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application yield resource Aug 22 20:30:02.144312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 20:30:02.144312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application next(self.gen) Aug 22 20:30:02.144312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 20:30:02.144312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 20:30:02.144312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 20:30:02.144312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 20:30:02.144312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 20:30:02.144312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise self.value Aug 22 20:30:02.144312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 20:30:02.144312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 20:30:02.144312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 20:30:02.144312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application session.commit() Aug 22 20:30:02.144312 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 20:30:02.145244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 20:30:02.145244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 20:30:02.145244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 20:30:02.145244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 20:30:02.145244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application self.session.flush() Aug 22 20:30:02.145244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 20:30:02.145244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 20:30:02.145244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 20:30:02.145244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 20:30:02.145244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 20:30:02.145244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application compat.raise_( Aug 22 20:30:02.145244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 20:30:02.145244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception Aug 22 20:30:02.145244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 20:30:02.145244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 20:30:02.145244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 20:30:02.145244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 20:30:02.146222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 20:30:02.146222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 20:30:02.146222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 20:30:02.146222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 20:30:02.146222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 22 20:30:02.146222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 22 20:30:02.146222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 20:30:02.146222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 20:30:02.146222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 20:30:02.146222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 20:30:02.146222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 20:30:02.146222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 20:30:02.146222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 20:30:02.146222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 20:30:02.146222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 20:30:02.147034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 20:30:02.147034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 20:30:02.147034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception Aug 22 20:30:02.147034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 20:30:02.147034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 20:30:02.147034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 20:30:02.147034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 20:30:02.147034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 20:30:02.147034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 20:30:02.147034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 20:30:02.147034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application conn.query(q) Aug 22 20:30:02.147034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 20:30:02.147034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 20:30:02.147034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 20:30:02.147034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application result.read() Aug 22 20:30:02.147034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 20:30:02.147034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 20:30:02.148168 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 20:30:02.148168 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 20:30:02.148168 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 20:30:02.148168 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 20:30:02.148168 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 20:30:02.148168 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 20:30:02.148168 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 20:30:02.148168 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 20:30:02.148168 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [parameters: {'id': 'b24971109fec4010a369e4e5caae4d10', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 20:30:02.148168 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 20:30:02.148168 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:30:02.148168 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:30:02.148168 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:30:02.148168 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:02.148168 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 22 20:30:02.149678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 22 20:30:02.149678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 20:30:02.149678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 20:30:02.149678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 22 20:30:02.149678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:30:02.149678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:30:02.149678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:30:02.149678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:02.149678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:30:02.149678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:30:02.149678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:30:02.149678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:30:02.149678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:30:02.149678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:30:02.149678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:30:02.149678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:30:02.149678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:30:02.152015 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:30:02.152015 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 22 20:30:02.152015 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 22 20:30:02.152015 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:30:02.152015 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:30:02.152015 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 22 20:30:02.152015 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 22 20:30:02.152015 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b24971109fec4010a369e4e5caae4d10. Aug 22 20:30:02.152015 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:30:02.152015 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 403/792] 10.222.0.15 () {60 vars in 1140 bytes} [Mon Aug 22 20:30:01 2022] POST /identity/v3/projects => generated 262 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:30:02.152015 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc8d0b-5a2e-449d-aba1-91baf224c0a4 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:02.158653 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:02.167657 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dc54f-1025-40e7-84a3-03f96e0b764a None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:02.208568 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9125c2-7679-412d-bdde-ca6a4556e968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:02.209336 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9125c2-7679-412d-bdde-ca6a4556e968 None admin] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:02.209767 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9125c2-7679-412d-bdde-ca6a4556e968 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:02.210106 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9125c2-7679-412d-bdde-ca6a4556e968 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:02.210208 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:02.211057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9125c2-7679-412d-bdde-ca6a4556e968 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:02.213611 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9125c2-7679-412d-bdde-ca6a4556e968 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:02.260827 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc8d0b-5a2e-449d-aba1-91baf224c0a4 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:02.292775 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef72f0-ea0e-434a-bcdd-183400a664e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:02.293402 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef72f0-ea0e-434a-bcdd-183400a664e9 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:02.293683 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef72f0-ea0e-434a-bcdd-183400a664e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:02.293956 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef72f0-ea0e-434a-bcdd-183400a664e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:02.300922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef72f0-ea0e-434a-bcdd-183400a664e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:02.302556 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef72f0-ea0e-434a-bcdd-183400a664e9 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:02.314241 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-70ef72f0-ea0e-434a-bcdd-183400a664e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:30:02.314241 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:02.314241 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:30:02.314241 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:30:02.314241 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:30:02.314241 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:30:02.314241 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:30:02.314241 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:30:02.314241 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:30:02.314241 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:30:02.314241 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:30:02.314241 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:30:02.314241 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:30:02.314241 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:30:02.314241 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:30:02.315258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:30:02.315258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:30:02.315258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:30:02.315258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:30:02.315258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:30:02.315258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:30:02.315258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:30:02.315258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:30:02.315258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:30:02.315258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:30:02.315258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:30:02.315258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:30:02.315258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:30:02.315258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:30:02.315258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:30:02.315258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:30:02.315258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:30:02.316192 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:30:02.316192 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:30:02.316192 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:30:02.316192 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:30:02.316192 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:30:02.316192 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:30:02.316192 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:30:02.316192 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:30:02.316192 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 404/793] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:30:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:30:02.321012 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef72f0-ea0e-434a-bcdd-183400a664e9 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:02.377747 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 390/794] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 20:30:02 2022] POST /identity/v3/endpoints => generated 347 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:30:02.425177 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef72f0-ea0e-434a-bcdd-183400a664e9 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:02.445985 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:02.474332 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfbbc1-8092-41e2-a84e-ad50d86e8508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:02.474953 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfbbc1-8092-41e2-a84e-ad50d86e8508 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:02.475237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfbbc1-8092-41e2-a84e-ad50d86e8508 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:02.475512 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfbbc1-8092-41e2-a84e-ad50d86e8508 None admin] PATH_INFO: `/v3/projects` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:02.476234 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfbbc1-8092-41e2-a84e-ad50d86e8508 None admin] RBAC: Adding query filter params (name=service) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:02.476538 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfbbc1-8092-41e2-a84e-ad50d86e8508 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:02.478017 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfbbc1-8092-41e2-a84e-ad50d86e8508 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:02.498608 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 405/795] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 20:30:02 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:30:04.590918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7abed-754c-43cd-9280-a962cf726a75 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:04.591508 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7abed-754c-43cd-9280-a962cf726a75 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:04.591508 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7abed-754c-43cd-9280-a962cf726a75 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:04.592998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 391/796] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:30:04.599203 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a748ed-96b5-4c64-be42-dffc9d737ca1 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:04.599812 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a748ed-96b5-4c64-be42-dffc9d737ca1 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:04.599812 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a748ed-96b5-4c64-be42-dffc9d737ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:04.621506 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-f8a748ed-96b5-4c64-be42-dffc9d737ca1 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:30:04.623747 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-f8a748ed-96b5-4c64-be42-dffc9d737ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:30:04.693432 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 406/797] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:30:04 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:30:04.761959 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3655e-2398-45a1-9bdc-5ff6b92112e5 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:04.762241 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3655e-2398-45a1-9bdc-5ff6b92112e5 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:04.762536 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3655e-2398-45a1-9bdc-5ff6b92112e5 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:04.763915 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 392/798] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:30:04.769157 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d14e9-e05c-4374-bd52-3c0ae146bbb4 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:04.769448 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d14e9-e05c-4374-bd52-3c0ae146bbb4 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:04.769729 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d14e9-e05c-4374-bd52-3c0ae146bbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:04.787703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-9b5d14e9-e05c-4374-bd52-3c0ae146bbb4 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:30:04.789912 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-9b5d14e9-e05c-4374-bd52-3c0ae146bbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:30:04.863173 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 407/799] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:30:04 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:30:05.021544 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3655e-2398-45a1-9bdc-5ff6b92112e5 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:05.129884 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3655e-2398-45a1-9bdc-5ff6b92112e5 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:05.163228 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4f2e2-9dc0-4dd5-a29a-20a21246f6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:05.163880 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4f2e2-9dc0-4dd5-a29a-20a21246f6c2 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:05.164162 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4f2e2-9dc0-4dd5-a29a-20a21246f6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:05.164437 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4f2e2-9dc0-4dd5-a29a-20a21246f6c2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:05.165015 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4f2e2-9dc0-4dd5-a29a-20a21246f6c2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:05.166382 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4f2e2-9dc0-4dd5-a29a-20a21246f6c2 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:05.175704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-6df4f2e2-9dc0-4dd5-a29a-20a21246f6c2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:30:05.175704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:05.175704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:30:05.175704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:30:05.175704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:30:05.175704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:30:05.175704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:30:05.175704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:30:05.175704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:30:05.175704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:30:05.175704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:30:05.175704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:30:05.175704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:05.175704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:30:05.175704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:30:05.175704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:30:05.175704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:30:05.176784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:30:05.176784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:30:05.176784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:30:05.176784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:30:05.176784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:30:05.176784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:30:05.176784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:30:05.176784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:30:05.176784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:30:05.176784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:30:05.176784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:30:05.176784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:30:05.176784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:30:05.176784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:30:05.176784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:30:05.176784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:30:05.177631 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:30:05.177631 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:30:05.177631 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:30:05.177631 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:30:05.177631 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:30:05.177631 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:30:05.177631 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:30:05.177631 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:30:05.177631 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:30:05.177631 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:30:05.177631 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:30:05.177631 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:30:05.177631 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:30:05.177631 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:30:05.177631 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 393/800] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:30:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:30:05.182798 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d14e9-e05c-4374-bd52-3c0ae146bbb4 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:05.192064 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4f2e2-9dc0-4dd5-a29a-20a21246f6c2 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:05.211095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:05.218543 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:05.290228 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d14e9-e05c-4374-bd52-3c0ae146bbb4 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:05.300631 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4f2e2-9dc0-4dd5-a29a-20a21246f6c2 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:05.326370 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014eafe1-661e-43c3-b1ee-1eb5e5001eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:05.327000 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014eafe1-661e-43c3-b1ee-1eb5e5001eaf None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:05.327283 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014eafe1-661e-43c3-b1ee-1eb5e5001eaf None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:05.327679 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014eafe1-661e-43c3-b1ee-1eb5e5001eaf None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:05.328239 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014eafe1-661e-43c3-b1ee-1eb5e5001eaf None admin] RBAC: Adding query filter params (name=compute) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:05.328545 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014eafe1-661e-43c3-b1ee-1eb5e5001eaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:05.329927 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014eafe1-661e-43c3-b1ee-1eb5e5001eaf None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:05.335166 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 408/801] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 20:30:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:05.335321 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbcfda-2992-4e37-94eb-d0c6f849676c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:05.335955 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbcfda-2992-4e37-94eb-d0c6f849676c None admin] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:05.336237 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbcfda-2992-4e37-94eb-d0c6f849676c None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:05.336510 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbcfda-2992-4e37-94eb-d0c6f849676c None admin] PATH_INFO: `/v3/users` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:05.337139 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbcfda-2992-4e37-94eb-d0c6f849676c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:05.338576 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbcfda-2992-4e37-94eb-d0c6f849676c None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:05.340660 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014eafe1-661e-43c3-b1ee-1eb5e5001eaf None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:05.342112 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: WARNING keystone.server.flask.common [None req-5cdbcfda-2992-4e37-94eb-d0c6f849676c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 22 20:30:05.393404 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.sql.core [None req-5cdbcfda-2992-4e37-94eb-d0c6f849676c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 20:30:05.393404 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 20:30:05.393404 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [parameters: {'user_id': '3aeebf594566495d93e6f4adef9e1d0d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 20:30:05.393404 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88641) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 20:30:05.410856 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-5cdbcfda-2992-4e37-94eb-d0c6f849676c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 20:30:05.410856 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:05.410856 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 20:30:05.410856 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 20:30:05.410856 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 20:30:05.410856 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 20:30:05.410856 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 20:30:05.410856 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 20:30:05.410856 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 20:30:05.410856 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application conn.query(q) Aug 22 20:30:05.410856 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 20:30:05.410856 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 20:30:05.410856 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 20:30:05.410856 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application result.read() Aug 22 20:30:05.410856 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 20:30:05.411988 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 20:30:05.411988 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 20:30:05.411988 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 20:30:05.411988 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 20:30:05.411988 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 20:30:05.411988 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 20:30:05.411988 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 20:30:05.411988 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 20:30:05.411988 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:30:05.411988 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 20:30:05.411988 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:30:05.411988 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:05.411988 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 20:30:05.411988 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 20:30:05.411988 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 22 20:30:05.411988 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 22 20:30:05.411988 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 20:30:05.411988 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application next(self.gen) Aug 22 20:30:05.412945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 20:30:05.412945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application yield resource Aug 22 20:30:05.412945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 20:30:05.412945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application next(self.gen) Aug 22 20:30:05.412945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 20:30:05.412945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 20:30:05.412945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 20:30:05.412945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 20:30:05.412945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 20:30:05.412945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise self.value Aug 22 20:30:05.412945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 20:30:05.412945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 20:30:05.412945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 20:30:05.412945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application session.commit() Aug 22 20:30:05.412945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 20:30:05.412945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 20:30:05.412945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 20:30:05.413820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 20:30:05.413820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 20:30:05.413820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self.session.flush() Aug 22 20:30:05.413820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 20:30:05.413820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 20:30:05.413820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 20:30:05.413820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 20:30:05.413820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 20:30:05.413820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application compat.raise_( Aug 22 20:30:05.413820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 20:30:05.413820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception Aug 22 20:30:05.413820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 20:30:05.413820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 20:30:05.413820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 20:30:05.413820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 20:30:05.413820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 20:30:05.413820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 20:30:05.414687 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 20:30:05.414687 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 20:30:05.414687 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 22 20:30:05.414687 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 22 20:30:05.414687 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 20:30:05.414687 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 20:30:05.414687 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 20:30:05.414687 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 20:30:05.414687 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 20:30:05.414687 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 20:30:05.414687 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 20:30:05.414687 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 20:30:05.414687 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 20:30:05.414687 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 20:30:05.414687 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 20:30:05.414687 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception Aug 22 20:30:05.415517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 20:30:05.415517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 20:30:05.415517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 20:30:05.415517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 20:30:05.415517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 20:30:05.415517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 20:30:05.415517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 20:30:05.415517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application conn.query(q) Aug 22 20:30:05.415517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 20:30:05.415517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 20:30:05.415517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 20:30:05.415517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application result.read() Aug 22 20:30:05.415517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 20:30:05.415517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 20:30:05.415517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 20:30:05.415517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 20:30:05.416740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 20:30:05.416740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 20:30:05.416740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 20:30:05.416740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 20:30:05.416740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 20:30:05.416740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 20:30:05.416740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [parameters: {'user_id': '3aeebf594566495d93e6f4adef9e1d0d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 20:30:05.416740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 20:30:05.416740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:30:05.416740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:30:05.416740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:30:05.416740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:05.416740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:30:05.416740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:30:05.416740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:30:05.417857 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:30:05.417857 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:30:05.417857 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:30:05.417857 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:30:05.417857 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:30:05.417857 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:30:05.417857 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:30:05.417857 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 22 20:30:05.417857 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 22 20:30:05.417857 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:30:05.417857 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:30:05.417857 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:30:05.417857 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:30:05.417857 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:30:05.417857 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:30:05.417857 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 22 20:30:05.417857 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 22 20:30:05.419142 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 22 20:30:05.419142 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 22 20:30:05.419142 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 20:30:05.419142 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 20:30:05.419142 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 20:30:05.419142 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:30:05.419142 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 394/802] 10.222.0.15 () {60 vars in 1131 bytes} [Mon Aug 22 20:30:05 2022] POST /identity/v3/users => generated 160 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:30:05.419658 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbcfda-2992-4e37-94eb-d0c6f849676c None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:05.451357 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:05.457460 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014eafe1-661e-43c3-b1ee-1eb5e5001eaf None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:05.497203 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9500e1-9c51-4362-b851-9d93679609b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:05.497846 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9500e1-9c51-4362-b851-9d93679609b5 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:05.498132 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9500e1-9c51-4362-b851-9d93679609b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:05.498732 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9500e1-9c51-4362-b851-9d93679609b5 None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:05.499045 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9500e1-9c51-4362-b851-9d93679609b5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:05.499467 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9500e1-9c51-4362-b851-9d93679609b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:05.500831 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9500e1-9c51-4362-b851-9d93679609b5 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:05.505983 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 409/803] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 20:30:05 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:30:05.513660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:05.545734 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbcfda-2992-4e37-94eb-d0c6f849676c None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:05.584943 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf801b-9074-4fae-982d-6f3c4795aa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:05.585600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf801b-9074-4fae-982d-6f3c4795aa83 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:05.585879 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf801b-9074-4fae-982d-6f3c4795aa83 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:05.586149 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf801b-9074-4fae-982d-6f3c4795aa83 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:05.595505 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf801b-9074-4fae-982d-6f3c4795aa83 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:05.597229 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf801b-9074-4fae-982d-6f3c4795aa83 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:05.609660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-10cf801b-9074-4fae-982d-6f3c4795aa83 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:30:05.609660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:05.609660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:30:05.609660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:30:05.609660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:30:05.609660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:30:05.609660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:30:05.609660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:30:05.609660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:30:05.609660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:30:05.609660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:30:05.609660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:30:05.609660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:30:05.609660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:30:05.609660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:30:05.609660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:30:05.610928 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:30:05.610928 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:30:05.610928 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:30:05.610928 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:30:05.610928 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:30:05.610928 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:30:05.610928 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:30:05.610928 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:30:05.610928 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:30:05.610928 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:30:05.610928 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:30:05.610928 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:30:05.610928 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:30:05.610928 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:30:05.610928 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:30:05.610928 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:30:05.610928 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:30:05.610928 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:30:05.612364 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:30:05.612364 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:30:05.612364 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:30:05.612364 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:30:05.612364 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:30:05.612364 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:30:05.612364 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:30:05.612364 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:30:05.612364 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:30:05.612364 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:30:05.612364 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 395/804] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:30:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:30:05.617202 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9500e1-9c51-4362-b851-9d93679609b5 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:05.732297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9500e1-9c51-4362-b851-9d93679609b5 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:05.769084 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc715e56-2b03-4a28-9ab9-5ecbc4521d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:05.769702 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc715e56-2b03-4a28-9ab9-5ecbc4521d3f None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:05.769983 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc715e56-2b03-4a28-9ab9-5ecbc4521d3f None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:05.770266 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc715e56-2b03-4a28-9ab9-5ecbc4521d3f None admin] PATH_INFO: `/v3/users` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:05.770973 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc715e56-2b03-4a28-9ab9-5ecbc4521d3f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:05.771281 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc715e56-2b03-4a28-9ab9-5ecbc4521d3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:05.772780 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc715e56-2b03-4a28-9ab9-5ecbc4521d3f None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:05.810966 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 410/805] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 20:30:05 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:07.705113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc327e5-ff53-4ff8-8149-d57c9c53d2cc None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:07.705663 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc327e5-ff53-4ff8-8149-d57c9c53d2cc None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:07.705663 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc327e5-ff53-4ff8-8149-d57c9c53d2cc None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:07.709782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 396/806] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:30:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:30:07.715323 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1c411-da61-4045-83f4-f0b64bc94c74 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:07.715800 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1c411-da61-4045-83f4-f0b64bc94c74 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:07.715913 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1c411-da61-4045-83f4-f0b64bc94c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:07.734296 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-8db1c411-da61-4045-83f4-f0b64bc94c74 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:30:07.735486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-8db1c411-da61-4045-83f4-f0b64bc94c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:30:07.749173 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:07.801357 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 411/807] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:30:07 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:30:08.131262 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc327e5-ff53-4ff8-8149-d57c9c53d2cc None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:08.235339 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc327e5-ff53-4ff8-8149-d57c9c53d2cc None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:08.268938 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accbfb1-ff35-4aae-bc0e-d2ad72920121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:08.269543 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accbfb1-ff35-4aae-bc0e-d2ad72920121 None admin] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:08.269818 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accbfb1-ff35-4aae-bc0e-d2ad72920121 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:08.270084 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accbfb1-ff35-4aae-bc0e-d2ad72920121 None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:08.270736 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6accbfb1-ff35-4aae-bc0e-d2ad72920121 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:08.272186 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6accbfb1-ff35-4aae-bc0e-d2ad72920121 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:08.275585 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:08.374842 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 397/808] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 20:30:08 2022] POST /identity/v3/services => generated 242 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:30:10.574809 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69115d-59f7-4973-a7a2-4e67a08f74e9 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:10.575354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69115d-59f7-4973-a7a2-4e67a08f74e9 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:10.575444 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69115d-59f7-4973-a7a2-4e67a08f74e9 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:10.576757 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 412/809] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:30:10.582117 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1891ae-8b4e-4e1a-9b1c-58c4f6f5946c None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:10.582558 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1891ae-8b4e-4e1a-9b1c-58c4f6f5946c None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:10.582684 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1891ae-8b4e-4e1a-9b1c-58c4f6f5946c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:10.602966 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-cc1891ae-8b4e-4e1a-9b1c-58c4f6f5946c None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:30:10.604593 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-cc1891ae-8b4e-4e1a-9b1c-58c4f6f5946c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:30:10.677537 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 398/810] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:30:10 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:30:10.999289 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69115d-59f7-4973-a7a2-4e67a08f74e9 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:11.104783 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69115d-59f7-4973-a7a2-4e67a08f74e9 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:11.138320 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441497a7-3c5e-42e7-a5ea-c0e1dd16171e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:11.138941 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441497a7-3c5e-42e7-a5ea-c0e1dd16171e None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:11.139218 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441497a7-3c5e-42e7-a5ea-c0e1dd16171e None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:11.139488 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441497a7-3c5e-42e7-a5ea-c0e1dd16171e None admin] PATH_INFO: `/v3/services/compute` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:11.140138 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441497a7-3c5e-42e7-a5ea-c0e1dd16171e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:11.141507 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441497a7-3c5e-42e7-a5ea-c0e1dd16171e None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:11.150136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-441497a7-3c5e-42e7-a5ea-c0e1dd16171e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:30:11.150136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:11.150136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:30:11.150136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:30:11.150136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:30:11.150136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:30:11.150136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:30:11.150136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:30:11.150136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:30:11.150136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:30:11.150136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:30:11.150136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:30:11.150136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:11.150136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:30:11.150136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:30:11.150136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:30:11.150136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:30:11.151363 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:30:11.151363 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:30:11.151363 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:30:11.151363 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:30:11.151363 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:30:11.151363 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:30:11.151363 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:30:11.151363 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:30:11.151363 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:30:11.151363 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:30:11.151363 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:30:11.151363 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:30:11.151363 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:30:11.151363 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:30:11.151363 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:30:11.151363 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:30:11.152639 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:30:11.152639 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:30:11.152639 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:30:11.152639 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:30:11.152639 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:30:11.152639 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:30:11.152639 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:30:11.152639 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:30:11.152639 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:30:11.152639 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:30:11.152639 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:30:11.152639 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:30:11.152639 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:30:11.152639 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:30:11.152639 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 413/811] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:30:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:30:11.158270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1891ae-8b4e-4e1a-9b1c-58c4f6f5946c None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:11.268968 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1891ae-8b4e-4e1a-9b1c-58c4f6f5946c None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:11.289675 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:11.303094 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3b42c-fc3f-4038-bb76-6f753ded3f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:11.303768 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3b42c-fc3f-4038-bb76-6f753ded3f0d None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:11.304013 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3b42c-fc3f-4038-bb76-6f753ded3f0d None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:11.304279 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3b42c-fc3f-4038-bb76-6f753ded3f0d None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:11.304895 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3b42c-fc3f-4038-bb76-6f753ded3f0d None admin] RBAC: Adding query filter params (name=compute) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:11.305192 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3b42c-fc3f-4038-bb76-6f753ded3f0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:11.306649 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3b42c-fc3f-4038-bb76-6f753ded3f0d None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:11.311561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 399/812] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 20:30:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:11.317467 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441497a7-3c5e-42e7-a5ea-c0e1dd16171e None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:11.333508 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:11.424145 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441497a7-3c5e-42e7-a5ea-c0e1dd16171e None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:11.458865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489d232-8a30-48ef-a5ca-a2572f50ee7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:11.459477 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489d232-8a30-48ef-a5ca-a2572f50ee7f None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:11.459788 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489d232-8a30-48ef-a5ca-a2572f50ee7f None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:11.460357 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489d232-8a30-48ef-a5ca-a2572f50ee7f None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:11.460999 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489d232-8a30-48ef-a5ca-a2572f50ee7f None admin] RBAC: Adding query filter params (type=compute) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:11.461306 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489d232-8a30-48ef-a5ca-a2572f50ee7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:11.462684 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489d232-8a30-48ef-a5ca-a2572f50ee7f None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:11.468294 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 414/813] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 20:30:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:11.474502 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3b42c-fc3f-4038-bb76-6f753ded3f0d None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:11.580598 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3b42c-fc3f-4038-bb76-6f753ded3f0d None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:11.614825 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f75a4d-91b8-4d2a-96b8-daf9986ed167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:11.615458 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f75a4d-91b8-4d2a-96b8-daf9986ed167 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:11.615735 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f75a4d-91b8-4d2a-96b8-daf9986ed167 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:11.616011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f75a4d-91b8-4d2a-96b8-daf9986ed167 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:11.616714 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f75a4d-91b8-4d2a-96b8-daf9986ed167 None admin] RBAC: Adding query filter params (interface=public, service_id=a6a1f5ffd79e4d759eaf1a27a6289038, region_id=RegionOne) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:11.617020 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f75a4d-91b8-4d2a-96b8-daf9986ed167 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:11.618402 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f75a4d-91b8-4d2a-96b8-daf9986ed167 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:11.624129 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 400/814] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Aug 22 20:30:11 2022] GET /identity/v3/endpoints?service_id=a6a1f5ffd79e4d759eaf1a27a6289038&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:11.630154 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489d232-8a30-48ef-a5ca-a2572f50ee7f None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:11.710893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:11.733206 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489d232-8a30-48ef-a5ca-a2572f50ee7f None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:11.768573 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b73f5-7a71-4527-83e7-625793b3a474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:11.769231 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b73f5-7a71-4527-83e7-625793b3a474 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:11.769512 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b73f5-7a71-4527-83e7-625793b3a474 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:11.769785 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b73f5-7a71-4527-83e7-625793b3a474 None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:11.770399 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b73f5-7a71-4527-83e7-625793b3a474 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:11.771794 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b73f5-7a71-4527-83e7-625793b3a474 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:11.778238 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 415/815] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Aug 22 20:30:11 2022] GET /identity/v3/services => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:30:14.024129 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2333a4f-253a-445b-9ca7-d9c778c0aec7 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:14.024681 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2333a4f-253a-445b-9ca7-d9c778c0aec7 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:14.024681 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2333a4f-253a-445b-9ca7-d9c778c0aec7 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:14.026440 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 401/816] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:30:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:30:14.032751 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cac1c-53a0-4c4c-a3c5-43e86c724583 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:14.033256 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cac1c-53a0-4c4c-a3c5-43e86c724583 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:14.033349 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cac1c-53a0-4c4c-a3c5-43e86c724583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:14.053800 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-7d6cac1c-53a0-4c4c-a3c5-43e86c724583 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:30:14.055054 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-7d6cac1c-53a0-4c4c-a3c5-43e86c724583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:30:14.123241 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 416/817] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:30:14 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:30:14.451765 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2333a4f-253a-445b-9ca7-d9c778c0aec7 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:14.501811 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:14.555016 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2333a4f-253a-445b-9ca7-d9c778c0aec7 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:14.589556 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0fc74-9ac6-4e41-8b20-ca879074b551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:14.590180 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0fc74-9ac6-4e41-8b20-ca879074b551 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:14.590461 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0fc74-9ac6-4e41-8b20-ca879074b551 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:14.590734 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0fc74-9ac6-4e41-8b20-ca879074b551 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:14.591856 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0fc74-9ac6-4e41-8b20-ca879074b551 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:14.593237 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0fc74-9ac6-4e41-8b20-ca879074b551 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:14.601986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-3ca0fc74-9ac6-4e41-8b20-ca879074b551 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:30:14.601986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:14.601986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:30:14.601986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:30:14.601986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:30:14.601986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:30:14.601986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:30:14.601986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:30:14.601986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:30:14.601986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:30:14.601986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:30:14.601986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:30:14.601986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:14.601986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:30:14.601986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:30:14.601986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:30:14.601986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:30:14.603312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:30:14.603312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:30:14.603312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:30:14.603312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:30:14.603312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:30:14.603312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:30:14.603312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:30:14.603312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:30:14.603312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:30:14.603312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:30:14.603312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:30:14.603312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:30:14.603312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:30:14.603312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:30:14.603312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:30:14.603312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:30:14.604507 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:30:14.604507 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:30:14.604507 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:30:14.604507 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:30:14.604507 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:30:14.604507 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:30:14.604507 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:30:14.604507 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:30:14.604507 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:30:14.604507 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:30:14.604507 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:30:14.604507 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:30:14.604507 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:30:14.604507 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:30:14.604507 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 402/818] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:30:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:30:14.609782 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cac1c-53a0-4c4c-a3c5-43e86c724583 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:14.685084 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:14.716418 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cac1c-53a0-4c4c-a3c5-43e86c724583 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:14.751039 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26e50d-f5da-4c9f-bad2-431c3a7b3eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:14.751748 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26e50d-f5da-4c9f-bad2-431c3a7b3eba None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:14.752026 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26e50d-f5da-4c9f-bad2-431c3a7b3eba None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:14.752295 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26e50d-f5da-4c9f-bad2-431c3a7b3eba None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:14.752925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26e50d-f5da-4c9f-bad2-431c3a7b3eba None admin] RBAC: Adding query filter params (name=compute) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:14.753227 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26e50d-f5da-4c9f-bad2-431c3a7b3eba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:14.754594 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26e50d-f5da-4c9f-bad2-431c3a7b3eba None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:14.759780 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 417/819] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 20:30:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:14.765877 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0fc74-9ac6-4e41-8b20-ca879074b551 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:14.873315 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0fc74-9ac6-4e41-8b20-ca879074b551 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:14.886294 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:14.907988 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0498a-af18-47f2-b2c5-194779f23372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:14.908634 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0498a-af18-47f2-b2c5-194779f23372 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:14.908918 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0498a-af18-47f2-b2c5-194779f23372 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:14.909194 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0498a-af18-47f2-b2c5-194779f23372 None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:14.909830 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0498a-af18-47f2-b2c5-194779f23372 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:14.910136 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0498a-af18-47f2-b2c5-194779f23372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:14.911516 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0498a-af18-47f2-b2c5-194779f23372 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:14.916698 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 403/820] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 20:30:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:14.923597 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26e50d-f5da-4c9f-bad2-431c3a7b3eba None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:15.028363 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26e50d-f5da-4c9f-bad2-431c3a7b3eba None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:15.062872 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaeab0-1fa6-4f17-a87b-aeb9782fc027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:15.063535 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaeab0-1fa6-4f17-a87b-aeb9782fc027 None admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:15.063776 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaeab0-1fa6-4f17-a87b-aeb9782fc027 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:15.064048 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaeab0-1fa6-4f17-a87b-aeb9782fc027 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:15.064699 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aaeab0-1fa6-4f17-a87b-aeb9782fc027 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:15.066067 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aaeab0-1fa6-4f17-a87b-aeb9782fc027 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:15.070814 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:15.124917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 418/821] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 20:30:14 2022] POST /identity/v3/endpoints => generated 334 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:30:24.930038 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=12 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:25.120792 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=4,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:31:47.739020 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d7e69-ead5-4b29-adc4-0eafc5207a09 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:47.739619 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d7e69-ead5-4b29-adc4-0eafc5207a09 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:47.739619 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d7e69-ead5-4b29-adc4-0eafc5207a09 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:47.741085 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 404/822] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:31:47.746809 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89baff8-411b-4611-ba8c-cf9c28957f8d None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:47.747292 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89baff8-411b-4611-ba8c-cf9c28957f8d None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:47.747388 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89baff8-411b-4611-ba8c-cf9c28957f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:47.766214 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-b89baff8-411b-4611-ba8c-cf9c28957f8d None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:31:47.769540 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-b89baff8-411b-4611-ba8c-cf9c28957f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:31:47.841882 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 419/823] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:31:47 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:31:48.168422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d7e69-ead5-4b29-adc4-0eafc5207a09 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:48.278769 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d7e69-ead5-4b29-adc4-0eafc5207a09 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:48.318871 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615dfca0-27ad-4c26-8cf6-940826921bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:48.319501 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dfca0-27ad-4c26-8cf6-940826921bf0 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:48.319822 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dfca0-27ad-4c26-8cf6-940826921bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:48.320095 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dfca0-27ad-4c26-8cf6-940826921bf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:48.330932 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615dfca0-27ad-4c26-8cf6-940826921bf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:48.332524 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615dfca0-27ad-4c26-8cf6-940826921bf0 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:48.348388 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-615dfca0-27ad-4c26-8cf6-940826921bf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:31:48.348388 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:31:48.348388 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:31:48.348388 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:31:48.348388 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:31:48.348388 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:31:48.348388 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:31:48.348388 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:31:48.348388 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:31:48.348388 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:31:48.348388 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:31:48.348388 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:31:48.348388 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:31:48.348388 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:31:48.348388 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:31:48.348388 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:31:48.358935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:31:48.358935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:31:48.358935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:31:48.358935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:31:48.358935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:31:48.358935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:31:48.358935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:31:48.358935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:31:48.358935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:31:48.358935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:31:48.358935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:31:48.358935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:31:48.358935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:31:48.358935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:31:48.358935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:31:48.358935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:31:48.358935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:31:48.359986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:31:48.359986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:31:48.359986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:31:48.359986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 405/824] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:31:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:31:48.360228 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89baff8-411b-4611-ba8c-cf9c28957f8d None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:48.458461 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89baff8-411b-4611-ba8c-cf9c28957f8d None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:48.485437 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:31:48.494745 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b27e6-8853-45e7-b5f4-40d0ef007f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:48.495352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b27e6-8853-45e7-b5f4-40d0ef007f11 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:48.495658 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b27e6-8853-45e7-b5f4-40d0ef007f11 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:48.495930 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b27e6-8853-45e7-b5f4-40d0ef007f11 None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:48.496596 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b27e6-8853-45e7-b5f4-40d0ef007f11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:31:48.496900 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b27e6-8853-45e7-b5f4-40d0ef007f11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:48.498272 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b27e6-8853-45e7-b5f4-40d0ef007f11 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:48.509696 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 420/825] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:31:48.516830 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615dfca0-27ad-4c26-8cf6-940826921bf0 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:48.571721 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:31:48.619127 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615dfca0-27ad-4c26-8cf6-940826921bf0 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:48.654400 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8d207-e524-4e2f-80e2-4cbac09b7c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:48.655860 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8d207-e524-4e2f-80e2-4cbac09b7c96 None admin] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:48.656141 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8d207-e524-4e2f-80e2-4cbac09b7c96 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:48.656410 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8d207-e524-4e2f-80e2-4cbac09b7c96 None admin] PATH_INFO: `/v3/users` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:48.657056 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8d207-e524-4e2f-80e2-4cbac09b7c96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:48.659322 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8d207-e524-4e2f-80e2-4cbac09b7c96 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:48.809315 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 406/826] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 20:31:48 2022] POST /identity/v3/users => generated 251 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:31:51.040533 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3994d-a209-4551-a9a4-7a5300b23b70 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:51.041197 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3994d-a209-4551-a9a4-7a5300b23b70 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:51.041197 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3994d-a209-4551-a9a4-7a5300b23b70 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:51.042408 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 421/827] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:31:51.048551 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c50b21-039e-49bc-80b9-7dd50966d6c9 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:51.051115 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c50b21-039e-49bc-80b9-7dd50966d6c9 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:51.051115 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c50b21-039e-49bc-80b9-7dd50966d6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:51.068337 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-97c50b21-039e-49bc-80b9-7dd50966d6c9 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:31:51.069579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-97c50b21-039e-49bc-80b9-7dd50966d6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:31:51.137220 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 407/828] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:31:51 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:31:51.466590 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3994d-a209-4551-a9a4-7a5300b23b70 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:51.573787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3994d-a209-4551-a9a4-7a5300b23b70 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:51.607786 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5b4e1-3d15-4c08-872a-e0c29f89d363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:51.608428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5b4e1-3d15-4c08-872a-e0c29f89d363 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:51.608709 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5b4e1-3d15-4c08-872a-e0c29f89d363 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:51.608980 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5b4e1-3d15-4c08-872a-e0c29f89d363 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:51.620603 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5b4e1-3d15-4c08-872a-e0c29f89d363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:31:51.625352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-e6c5b4e1-3d15-4c08-872a-e0c29f89d363 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:31:51.625352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:31:51.625352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:31:51.625352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:31:51.625352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:31:51.625352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:31:51.625352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:31:51.625352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:31:51.625352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:31:51.625352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:31:51.625352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:31:51.625352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:31:51.625352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:31:51.625352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:31:51.625352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:31:51.625352 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:31:51.626488 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:31:51.626488 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:31:51.626488 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:31:51.626488 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:31:51.626488 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:31:51.626488 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:31:51.626488 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:31:51.626488 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:31:51.626488 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:31:51.626488 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:31:51.626488 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:31:51.626488 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:31:51.626488 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:31:51.626488 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:31:51.626488 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:31:51.626488 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:31:51.627800 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:31:51.627800 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:31:51.627800 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:31:51.627800 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:31:51.627800 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:31:51.627800 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:31:51.627800 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:31:51.627800 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:31:51.627800 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:31:51.627800 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:31:51.627800 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:31:51.627800 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:31:51.627800 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 422/829] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 20:31:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:31:51.633617 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c50b21-039e-49bc-80b9-7dd50966d6c9 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:51.674204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:31:51.733845 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c50b21-039e-49bc-80b9-7dd50966d6c9 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:51.769491 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80169a59-e3a1-4f6a-82db-9f754b24530f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:51.770161 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80169a59-e3a1-4f6a-82db-9f754b24530f None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:51.770451 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80169a59-e3a1-4f6a-82db-9f754b24530f None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:51.770732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80169a59-e3a1-4f6a-82db-9f754b24530f None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:51.771398 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80169a59-e3a1-4f6a-82db-9f754b24530f None admin] RBAC: Adding query filter params (name=service) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:31:51.771737 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80169a59-e3a1-4f6a-82db-9f754b24530f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:51.773177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80169a59-e3a1-4f6a-82db-9f754b24530f None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:51.781568 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 408/830] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 20:31:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:31:51.788219 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5b4e1-3d15-4c08-872a-e0c29f89d363 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:51.836552 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:31:51.889549 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5b4e1-3d15-4c08-872a-e0c29f89d363 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:51.925944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5a7fa-2774-43e7-9bfb-01f12fd574ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:51.926593 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5a7fa-2774-43e7-9bfb-01f12fd574ba None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:51.926878 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5a7fa-2774-43e7-9bfb-01f12fd574ba None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:51.927156 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5a7fa-2774-43e7-9bfb-01f12fd574ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:51.938327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5a7fa-2774-43e7-9bfb-01f12fd574ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:51.939822 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5a7fa-2774-43e7-9bfb-01f12fd574ba None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:51.953862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-0cd5a7fa-2774-43e7-9bfb-01f12fd574ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:31:51.953862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:31:51.953862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:31:51.953862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:31:51.953862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:31:51.953862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:31:51.953862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:31:51.953862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:31:51.953862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:31:51.953862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:31:51.953862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:31:51.953862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:31:51.953862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:31:51.953862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:31:51.953862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:31:51.953862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:31:51.954891 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:31:51.954891 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:31:51.954891 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:31:51.954891 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:31:51.954891 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:31:51.954891 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:31:51.954891 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:31:51.954891 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:31:51.954891 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:31:51.954891 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:31:51.954891 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:31:51.954891 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:31:51.954891 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:31:51.954891 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:31:51.954891 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:31:51.954891 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:31:51.954891 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:31:51.955819 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:31:51.955819 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:31:51.955819 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:31:51.955819 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 423/831] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:31:51.962620 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80169a59-e3a1-4f6a-82db-9f754b24530f None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:52.062502 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:31:52.065498 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80169a59-e3a1-4f6a-82db-9f754b24530f None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:52.100235 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f2667-e0df-4056-b0cc-ce1088e13d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:52.100850 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f2667-e0df-4056-b0cc-ce1088e13d16 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:52.101134 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f2667-e0df-4056-b0cc-ce1088e13d16 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:52.101411 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f2667-e0df-4056-b0cc-ce1088e13d16 None admin] PATH_INFO: `/v3/domains` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:52.102057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f2667-e0df-4056-b0cc-ce1088e13d16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:31:52.102363 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f2667-e0df-4056-b0cc-ce1088e13d16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:52.103839 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f2667-e0df-4056-b0cc-ce1088e13d16 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:52.115459 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 409/832] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:31:52.121527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5a7fa-2774-43e7-9bfb-01f12fd574ba None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:52.223940 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:31:52.227813 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5a7fa-2774-43e7-9bfb-01f12fd574ba None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:52.262244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42110fd-85e8-4c28-9472-f4af5e3b4ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:52.268288 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42110fd-85e8-4c28-9472-f4af5e3b4ef2 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:52.268577 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42110fd-85e8-4c28-9472-f4af5e3b4ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:52.268878 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42110fd-85e8-4c28-9472-f4af5e3b4ef2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:52.277713 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42110fd-85e8-4c28-9472-f4af5e3b4ef2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:52.279271 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42110fd-85e8-4c28-9472-f4af5e3b4ef2 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:52.290722 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-e42110fd-85e8-4c28-9472-f4af5e3b4ef2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:31:52.290722 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:31:52.290722 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:31:52.290722 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:31:52.290722 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:31:52.290722 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:31:52.290722 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:31:52.290722 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:31:52.290722 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:31:52.290722 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:31:52.290722 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:31:52.290722 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:31:52.290722 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:31:52.290722 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:31:52.290722 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:31:52.290722 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:31:52.292034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:31:52.292034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:31:52.292034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:31:52.292034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:31:52.292034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:31:52.292034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:31:52.292034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:31:52.292034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:31:52.292034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:31:52.292034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:31:52.292034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:31:52.292034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:31:52.292034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:31:52.292034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:31:52.292034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:31:52.292034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:31:52.292034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:31:52.292034 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:31:52.293049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:31:52.293049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:31:52.293049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:31:52.293049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:31:52.293049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:31:52.293049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:31:52.293049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:31:52.293049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:31:52.293049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:31:52.293049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:31:52.293049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 424/833] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:31:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:31:52.298272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f2667-e0df-4056-b0cc-ce1088e13d16 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:52.402031 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f2667-e0df-4056-b0cc-ce1088e13d16 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:52.435187 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2c874-3231-4cb4-a4d3-00ebb2b95300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:52.435853 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2c874-3231-4cb4-a4d3-00ebb2b95300 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:52.436381 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2c874-3231-4cb4-a4d3-00ebb2b95300 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:52.436665 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2c874-3231-4cb4-a4d3-00ebb2b95300 None admin] PATH_INFO: `/v3/users` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:52.437400 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2c874-3231-4cb4-a4d3-00ebb2b95300 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:31:52.437704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2c874-3231-4cb4-a4d3-00ebb2b95300 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:52.439170 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2c874-3231-4cb4-a4d3-00ebb2b95300 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:52.458189 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 410/834] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Aug 22 20:31:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:31:52.464260 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42110fd-85e8-4c28-9472-f4af5e3b4ef2 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:52.568988 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42110fd-85e8-4c28-9472-f4af5e3b4ef2 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:52.615666 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84993d5-7cec-429f-9f1a-82f2dea641a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:52.616393 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84993d5-7cec-429f-9f1a-82f2dea641a5 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:52.616796 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84993d5-7cec-429f-9f1a-82f2dea641a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:52.617163 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84993d5-7cec-429f-9f1a-82f2dea641a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:52.645886 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:31:52.687360 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84993d5-7cec-429f-9f1a-82f2dea641a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:52.688770 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84993d5-7cec-429f-9f1a-82f2dea641a5 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:52.787958 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 425/835] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:31:52 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:31:52.794360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2c874-3231-4cb4-a4d3-00ebb2b95300 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:52.814346 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:31:52.896457 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2c874-3231-4cb4-a4d3-00ebb2b95300 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:52.931841 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a5f63-9701-454e-a5f0-4869009e7dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:52.932472 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a5f63-9701-454e-a5f0-4869009e7dc3 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:52.932744 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a5f63-9701-454e-a5f0-4869009e7dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:52.933014 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a5f63-9701-454e-a5f0-4869009e7dc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:52.954653 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a5f63-9701-454e-a5f0-4869009e7dc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:52.954653 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a5f63-9701-454e-a5f0-4869009e7dc3 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:52.960671 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-cc1a5f63-9701-454e-a5f0-4869009e7dc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:31:52.960671 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:31:52.960671 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:31:52.960671 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:31:52.960671 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:31:52.960671 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:31:52.960671 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:31:52.960671 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:31:52.960671 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:31:52.960671 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:31:52.960671 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:31:52.960671 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:31:52.960671 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:31:52.960671 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:31:52.960671 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:31:52.960671 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:31:52.961843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:31:52.961843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:31:52.961843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:31:52.961843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:31:52.961843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:31:52.961843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:31:52.961843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:31:52.961843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:31:52.961843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:31:52.961843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:31:52.961843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:31:52.961843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:31:52.961843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:31:52.961843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:31:52.961843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:31:52.961843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:31:52.961843 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:31:52.962911 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:31:52.962911 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:31:52.962911 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:31:52.963708 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 411/836] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:31:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:31:52.968069 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84993d5-7cec-429f-9f1a-82f2dea641a5 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:53.034443 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:31:53.078704 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84993d5-7cec-429f-9f1a-82f2dea641a5 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:53.112248 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab4687-2025-4c74-89e9-049f9dec6d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:53.112853 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab4687-2025-4c74-89e9-049f9dec6d21 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:53.113127 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab4687-2025-4c74-89e9-049f9dec6d21 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:53.113523 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab4687-2025-4c74-89e9-049f9dec6d21 None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:53.114652 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab4687-2025-4c74-89e9-049f9dec6d21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:31:53.114953 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab4687-2025-4c74-89e9-049f9dec6d21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:53.116337 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab4687-2025-4c74-89e9-049f9dec6d21 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:53.128197 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 426/837] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:31:53.133923 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a5f63-9701-454e-a5f0-4869009e7dc3 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:53.207153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:31:53.241292 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a5f63-9701-454e-a5f0-4869009e7dc3 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:53.277216 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca820c-4dc4-49fa-8609-429069f3fe67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:53.277858 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca820c-4dc4-49fa-8609-429069f3fe67 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:53.278138 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca820c-4dc4-49fa-8609-429069f3fe67 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:53.278432 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca820c-4dc4-49fa-8609-429069f3fe67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:53.286779 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca820c-4dc4-49fa-8609-429069f3fe67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:53.293905 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca820c-4dc4-49fa-8609-429069f3fe67 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:53.300270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-c7ca820c-4dc4-49fa-8609-429069f3fe67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:31:53.300270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:31:53.300270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:31:53.300270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:31:53.300270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:31:53.300270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:31:53.300270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:31:53.300270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:31:53.300270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:31:53.300270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:31:53.300270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:31:53.300270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:31:53.300270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:31:53.300270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:31:53.300270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:31:53.301444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:31:53.301444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:31:53.301444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:31:53.301444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:31:53.301444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:31:53.301444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:31:53.301444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:31:53.301444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:31:53.301444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:31:53.301444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:31:53.301444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:31:53.301444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:31:53.301444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:31:53.301444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:31:53.301444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:31:53.301444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:31:53.301444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:31:53.302387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:31:53.302387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:31:53.302387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:31:53.302387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:31:53.302387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:31:53.302387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:31:53.302387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:31:53.302387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:31:53.302387 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 412/838] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:31:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:31:53.307995 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab4687-2025-4c74-89e9-049f9dec6d21 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:53.423845 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab4687-2025-4c74-89e9-049f9dec6d21 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:53.441489 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:31:53.458665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffe2d3-de4f-4f8a-83c0-49e478fde0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:53.459189 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffe2d3-de4f-4f8a-83c0-49e478fde0d7 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:53.459478 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffe2d3-de4f-4f8a-83c0-49e478fde0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:53.459785 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffe2d3-de4f-4f8a-83c0-49e478fde0d7 None admin] PATH_INFO: `/v3/projects` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:53.460475 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffe2d3-de4f-4f8a-83c0-49e478fde0d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:31:53.460784 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffe2d3-de4f-4f8a-83c0-49e478fde0d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:53.462215 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffe2d3-de4f-4f8a-83c0-49e478fde0d7 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:53.474266 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 427/839] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 20:31:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:31:53.480601 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca820c-4dc4-49fa-8609-429069f3fe67 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:53.584569 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca820c-4dc4-49fa-8609-429069f3fe67 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:53.612553 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:31:53.618224 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d8b81-c8e6-401d-8174-db9efd1efb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:53.618873 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d8b81-c8e6-401d-8174-db9efd1efb6a None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:53.619154 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d8b81-c8e6-401d-8174-db9efd1efb6a None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:53.619425 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d8b81-c8e6-401d-8174-db9efd1efb6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:53.620182 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d8b81-c8e6-401d-8174-db9efd1efb6a None admin] RBAC: Adding query filter params (role.id=b92ee6686fe5412f9b7fdf27fb4c21d3, scope.project.id=7bda5c44ace24608b8ca69e9059d73ef, user.id=e4117090fe4047f9b6a2b5eab5ff218c) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:31:53.620493 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d8b81-c8e6-401d-8174-db9efd1efb6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:53.621931 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d8b81-c8e6-401d-8174-db9efd1efb6a None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:53.627372 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 413/840] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:31:53 2022] GET /identity/v3/role_assignments?user.id=e4117090fe4047f9b6a2b5eab5ff218c&scope.project.id=7bda5c44ace24608b8ca69e9059d73ef&role.id=b92ee6686fe5412f9b7fdf27fb4c21d3 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:31:55.803684 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b420d2-6d0f-4a17-bd18-b5070865725c None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:55.804288 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b420d2-6d0f-4a17-bd18-b5070865725c None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:55.804288 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b420d2-6d0f-4a17-bd18-b5070865725c None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:55.805715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 428/841] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:31:55.811698 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89745ee4-6c2b-4e9c-9a23-b991b37bdb50 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:55.812153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89745ee4-6c2b-4e9c-9a23-b991b37bdb50 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:55.812255 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89745ee4-6c2b-4e9c-9a23-b991b37bdb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:55.831759 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-89745ee4-6c2b-4e9c-9a23-b991b37bdb50 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:31:55.833554 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-89745ee4-6c2b-4e9c-9a23-b991b37bdb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:31:55.902702 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 414/842] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:31:55 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:31:56.233929 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b420d2-6d0f-4a17-bd18-b5070865725c None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:56.341055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b420d2-6d0f-4a17-bd18-b5070865725c None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:56.376401 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc6f56-10fd-48c7-acfa-c94635d12626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:56.377035 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc6f56-10fd-48c7-acfa-c94635d12626 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:56.377314 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc6f56-10fd-48c7-acfa-c94635d12626 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:56.377588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc6f56-10fd-48c7-acfa-c94635d12626 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:56.388275 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc6f56-10fd-48c7-acfa-c94635d12626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:31:56.392991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-5bbc6f56-10fd-48c7-acfa-c94635d12626 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:31:56.392991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:31:56.392991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:31:56.392991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:31:56.392991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:31:56.392991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:31:56.392991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:31:56.392991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:31:56.392991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:31:56.392991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:31:56.392991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:31:56.392991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:31:56.392991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:31:56.392991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:31:56.392991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:31:56.392991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:31:56.394267 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:31:56.394267 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:31:56.394267 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:31:56.394267 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:31:56.394267 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:31:56.394267 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:31:56.394267 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:31:56.394267 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:31:56.394267 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:31:56.394267 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:31:56.394267 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:31:56.394267 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:31:56.394267 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:31:56.394267 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:31:56.394267 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:31:56.394267 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:31:56.395244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:31:56.395244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:31:56.395244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:31:56.395244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:31:56.395244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:31:56.395244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:31:56.395244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:31:56.395244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:31:56.395244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:31:56.395244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:31:56.395244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:31:56.395244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:31:56.395244 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 429/843] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 20:31:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:31:56.400344 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89745ee4-6c2b-4e9c-9a23-b991b37bdb50 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:56.503928 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89745ee4-6c2b-4e9c-9a23-b991b37bdb50 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:56.530302 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:31:56.540983 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96e1c9-e2bb-44fe-8f26-d1fce399d5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:56.541594 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96e1c9-e2bb-44fe-8f26-d1fce399d5b2 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:56.541876 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96e1c9-e2bb-44fe-8f26-d1fce399d5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:56.542150 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96e1c9-e2bb-44fe-8f26-d1fce399d5b2 None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:56.542817 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96e1c9-e2bb-44fe-8f26-d1fce399d5b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:31:56.543159 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96e1c9-e2bb-44fe-8f26-d1fce399d5b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:56.544584 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96e1c9-e2bb-44fe-8f26-d1fce399d5b2 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:56.553406 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 415/844] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 20:31:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:31:56.559305 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc6f56-10fd-48c7-acfa-c94635d12626 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:56.601251 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:31:56.664481 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc6f56-10fd-48c7-acfa-c94635d12626 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:56.700059 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa08399-2dfd-430b-aac2-6a31558afebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:56.700687 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa08399-2dfd-430b-aac2-6a31558afebc None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:56.700959 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa08399-2dfd-430b-aac2-6a31558afebc None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:56.701233 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa08399-2dfd-430b-aac2-6a31558afebc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:56.711926 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa08399-2dfd-430b-aac2-6a31558afebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:56.713382 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa08399-2dfd-430b-aac2-6a31558afebc None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:56.728957 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-5aa08399-2dfd-430b-aac2-6a31558afebc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:31:56.728957 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:31:56.728957 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:31:56.728957 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:31:56.728957 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:31:56.728957 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:31:56.728957 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:31:56.728957 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:31:56.728957 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:31:56.728957 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:31:56.728957 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:31:56.728957 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:31:56.728957 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:31:56.728957 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:31:56.728957 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:31:56.728957 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:31:56.730473 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:31:56.730473 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:31:56.730473 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:31:56.730473 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:31:56.730473 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:31:56.730473 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:31:56.730473 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:31:56.730473 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:31:56.730473 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:31:56.730473 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:31:56.730473 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:31:56.730473 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:31:56.730473 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:31:56.730473 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:31:56.730473 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:31:56.730473 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:31:56.730473 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:31:56.731782 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:31:56.731782 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:31:56.731782 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:31:56.734997 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 430/845] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:31:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:31:56.736347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96e1c9-e2bb-44fe-8f26-d1fce399d5b2 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:56.841076 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96e1c9-e2bb-44fe-8f26-d1fce399d5b2 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:56.875916 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b83fff-b531-4898-8ee2-83284c8f5c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:56.876542 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b83fff-b531-4898-8ee2-83284c8f5c9d None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:56.876824 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b83fff-b531-4898-8ee2-83284c8f5c9d None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:56.877100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b83fff-b531-4898-8ee2-83284c8f5c9d None admin] PATH_INFO: `/v3/domains` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:56.877744 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b83fff-b531-4898-8ee2-83284c8f5c9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:31:56.878053 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b83fff-b531-4898-8ee2-83284c8f5c9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:56.879459 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b83fff-b531-4898-8ee2-83284c8f5c9d None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:56.892967 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 416/846] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:31:56.899010 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa08399-2dfd-430b-aac2-6a31558afebc None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:56.995129 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:31:57.004898 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa08399-2dfd-430b-aac2-6a31558afebc None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:57.043940 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70441dd6-b81b-4ea1-b53c-30fd6a8bbdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:57.044593 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70441dd6-b81b-4ea1-b53c-30fd6a8bbdba None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:57.044934 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70441dd6-b81b-4ea1-b53c-30fd6a8bbdba None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:57.045233 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70441dd6-b81b-4ea1-b53c-30fd6a8bbdba None admin] PATH_INFO: `/v3/users/placement` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:57.053480 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70441dd6-b81b-4ea1-b53c-30fd6a8bbdba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:57.054971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70441dd6-b81b-4ea1-b53c-30fd6a8bbdba None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:57.067181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-70441dd6-b81b-4ea1-b53c-30fd6a8bbdba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:31:57.067181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:31:57.067181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:31:57.067181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:31:57.067181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:31:57.067181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:31:57.067181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:31:57.067181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:31:57.067181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:31:57.067181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:31:57.067181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:31:57.067181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:31:57.067181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:31:57.067181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:31:57.067181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:31:57.067181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:31:57.071756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:31:57.071756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:31:57.071756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:31:57.071756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:31:57.071756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:31:57.071756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:31:57.071756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:31:57.071756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:31:57.071756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:31:57.071756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:31:57.071756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:31:57.071756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:31:57.071756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:31:57.071756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:31:57.071756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:31:57.071756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:31:57.071756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:31:57.071756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:31:57.073765 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:31:57.073765 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:31:57.073765 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:31:57.073765 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:31:57.073765 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:31:57.073765 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:31:57.073765 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:31:57.073765 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:31:57.073765 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:31:57.073765 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:31:57.073765 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 431/847] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:31:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:31:57.074899 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b83fff-b531-4898-8ee2-83284c8f5c9d None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:57.122752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:31:57.177163 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b83fff-b531-4898-8ee2-83284c8f5c9d None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:57.216713 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef96abb-76be-4c84-bddf-cbb52f15d6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:57.217361 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef96abb-76be-4c84-bddf-cbb52f15d6ab None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:57.217614 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef96abb-76be-4c84-bddf-cbb52f15d6ab None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:57.217885 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef96abb-76be-4c84-bddf-cbb52f15d6ab None admin] PATH_INFO: `/v3/users` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:57.218625 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef96abb-76be-4c84-bddf-cbb52f15d6ab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:31:57.218926 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef96abb-76be-4c84-bddf-cbb52f15d6ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:57.220391 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef96abb-76be-4c84-bddf-cbb52f15d6ab None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:57.238971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 417/848] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Aug 22 20:31:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:31:57.245388 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70441dd6-b81b-4ea1-b53c-30fd6a8bbdba None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:57.349984 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70441dd6-b81b-4ea1-b53c-30fd6a8bbdba None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:57.383339 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b69837-b8d8-4f34-8e3f-0aa70b533a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:57.383922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b69837-b8d8-4f34-8e3f-0aa70b533a8a None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:57.384204 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b69837-b8d8-4f34-8e3f-0aa70b533a8a None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:57.384480 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b69837-b8d8-4f34-8e3f-0aa70b533a8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:57.396163 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b69837-b8d8-4f34-8e3f-0aa70b533a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:57.397619 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b69837-b8d8-4f34-8e3f-0aa70b533a8a None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:57.412905 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-a2b69837-b8d8-4f34-8e3f-0aa70b533a8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:31:57.412905 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:31:57.412905 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:31:57.412905 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:31:57.412905 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:31:57.412905 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:31:57.412905 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:31:57.412905 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:31:57.412905 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:31:57.412905 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:31:57.412905 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:31:57.412905 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:31:57.412905 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:31:57.412905 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:31:57.412905 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:31:57.412905 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:31:57.414030 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:31:57.414030 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:31:57.414030 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:31:57.414030 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:31:57.414030 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:31:57.414030 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:31:57.414030 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:31:57.414030 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:31:57.414030 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:31:57.414030 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:31:57.414030 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:31:57.414030 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:31:57.414030 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:31:57.414030 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:31:57.414030 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:31:57.414030 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:31:57.414030 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:31:57.415102 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:31:57.415102 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:31:57.415102 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:31:57.415102 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 432/849] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:31:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:31:57.420062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef96abb-76be-4c84-bddf-cbb52f15d6ab None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:57.526225 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef96abb-76be-4c84-bddf-cbb52f15d6ab None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:57.528829 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:31:57.561511 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfec0a-e020-4879-ab91-f11ebfdfbdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:57.562123 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfec0a-e020-4879-ab91-f11ebfdfbdb3 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:57.562406 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfec0a-e020-4879-ab91-f11ebfdfbdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:57.562678 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfec0a-e020-4879-ab91-f11ebfdfbdb3 None admin] PATH_INFO: `/v3/domains` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:57.563312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfec0a-e020-4879-ab91-f11ebfdfbdb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:31:57.563656 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfec0a-e020-4879-ab91-f11ebfdfbdb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:57.565032 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfec0a-e020-4879-ab91-f11ebfdfbdb3 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:57.576851 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 418/850] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:31:57.583755 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b69837-b8d8-4f34-8e3f-0aa70b533a8a None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:57.586699 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:31:57.689333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b69837-b8d8-4f34-8e3f-0aa70b533a8a None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:57.726604 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1486a94-84b3-4d97-b9f6-cdc0ca6ffcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:57.727273 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1486a94-84b3-4d97-b9f6-cdc0ca6ffcb6 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:57.727575 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1486a94-84b3-4d97-b9f6-cdc0ca6ffcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:57.727853 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1486a94-84b3-4d97-b9f6-cdc0ca6ffcb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:57.735260 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1486a94-84b3-4d97-b9f6-cdc0ca6ffcb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:57.738414 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1486a94-84b3-4d97-b9f6-cdc0ca6ffcb6 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:57.748925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-e1486a94-84b3-4d97-b9f6-cdc0ca6ffcb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:31:57.748925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:31:57.748925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:31:57.748925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:31:57.748925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:31:57.748925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:31:57.748925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:31:57.748925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:31:57.748925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:31:57.748925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:31:57.748925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:31:57.748925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:31:57.748925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:31:57.748925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:31:57.748925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:31:57.750108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:31:57.750108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:31:57.750108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:31:57.750108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:31:57.750108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:31:57.750108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:31:57.750108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:31:57.750108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:31:57.750108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:31:57.750108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:31:57.750108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:31:57.750108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:31:57.750108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:31:57.750108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:31:57.750108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:31:57.750108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:31:57.750108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:31:57.751322 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:31:57.751322 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:31:57.751322 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:31:57.751322 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:31:57.751322 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:31:57.751322 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:31:57.751322 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:31:57.751322 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:31:57.751322 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 433/851] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:31:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:31:57.757020 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfec0a-e020-4879-ab91-f11ebfdfbdb3 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:57.861271 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfec0a-e020-4879-ab91-f11ebfdfbdb3 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:57.896441 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca224f8-33af-4711-8f67-29ddc792cc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:57.897105 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca224f8-33af-4711-8f67-29ddc792cc7b None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:57.897396 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca224f8-33af-4711-8f67-29ddc792cc7b None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:57.897672 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca224f8-33af-4711-8f67-29ddc792cc7b None admin] PATH_INFO: `/v3/projects` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:57.898359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca224f8-33af-4711-8f67-29ddc792cc7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:31:57.898668 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca224f8-33af-4711-8f67-29ddc792cc7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:57.900140 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca224f8-33af-4711-8f67-29ddc792cc7b None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:57.912230 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 419/852] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 20:31:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:31:57.918391 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1486a94-84b3-4d97-b9f6-cdc0ca6ffcb6 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:31:57.981190 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:31:58.019747 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1486a94-84b3-4d97-b9f6-cdc0ca6ffcb6 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:31:58.053600 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee6e52-c50c-4955-8b9e-b208a0a1f110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:31:58.054262 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee6e52-c50c-4955-8b9e-b208a0a1f110 None admin] REQUEST_METHOD: `PUT` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:31:58.059272 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee6e52-c50c-4955-8b9e-b208a0a1f110 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:31:58.059272 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee6e52-c50c-4955-8b9e-b208a0a1f110 None admin] PATH_INFO: `/v3/projects/7bda5c44ace24608b8ca69e9059d73ef/users/e4117090fe4047f9b6a2b5eab5ff218c/roles/b92ee6686fe5412f9b7fdf27fb4c21d3` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:31:58.070384 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee6e52-c50c-4955-8b9e-b208a0a1f110 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bda5c44ace24608b8ca69e9059d73ef, user_id=e4117090fe4047f9b6a2b5eab5ff218c, role_id=b92ee6686fe5412f9b7fdf27fb4c21d3)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:31:58.071964 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee6e52-c50c-4955-8b9e-b208a0a1f110 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:31:58.282308 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 434/853] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 20:31:57 2022] PUT /identity/v3/projects/7bda5c44ace24608b8ca69e9059d73ef/users/e4117090fe4047f9b6a2b5eab5ff218c/roles/b92ee6686fe5412f9b7fdf27fb4c21d3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:32:00.514638 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd0a6c-6081-404f-b27f-31db5aa288bf None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:00.515202 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd0a6c-6081-404f-b27f-31db5aa288bf None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:00.515202 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd0a6c-6081-404f-b27f-31db5aa288bf None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:00.516572 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 420/854] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:32:00.523163 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765f189-7aa6-47a8-a808-3867db6068b2 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:00.523746 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765f189-7aa6-47a8-a808-3867db6068b2 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:00.524260 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765f189-7aa6-47a8-a808-3867db6068b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:00.547295 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-3765f189-7aa6-47a8-a808-3867db6068b2 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:32:00.548577 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-3765f189-7aa6-47a8-a808-3867db6068b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:32:00.617709 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 435/855] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:32:00 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:32:00.968880 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd0a6c-6081-404f-b27f-31db5aa288bf None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:00.995586 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:01.077614 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd0a6c-6081-404f-b27f-31db5aa288bf None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:01.114306 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf858d9c-de7b-4a75-a766-159d565136d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:01.114933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf858d9c-de7b-4a75-a766-159d565136d1 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:01.115209 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf858d9c-de7b-4a75-a766-159d565136d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:01.115489 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf858d9c-de7b-4a75-a766-159d565136d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:01.125480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf858d9c-de7b-4a75-a766-159d565136d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:32:01.130679 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-cf858d9c-de7b-4a75-a766-159d565136d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:32:01.130679 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:01.130679 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:01.130679 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:01.130679 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:01.130679 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:01.130679 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:01.130679 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:01.130679 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:01.130679 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:01.130679 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:01.130679 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:01.130679 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:32:01.130679 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:32:01.130679 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:32:01.130679 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:32:01.133490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:32:01.133490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:32:01.133490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:32:01.133490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:32:01.133490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:01.133490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:01.133490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:01.133490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:01.133490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:01.133490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:01.133490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:01.133490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:01.133490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:01.133490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:01.133490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:01.133490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:01.134339 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:01.134339 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:01.134339 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:01.134339 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:01.134339 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:32:01.134339 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:32:01.134339 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:32:01.134339 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:32:01.134339 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:32:01.134339 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:32:01.134339 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:32:01.134339 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:32:01.134339 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 421/856] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 20:32:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:32:01.138331 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765f189-7aa6-47a8-a808-3867db6068b2 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:01.185517 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:01.244075 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765f189-7aa6-47a8-a808-3867db6068b2 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:01.279454 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ed0b0-b012-4938-acbf-1286e74c832f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:01.280103 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ed0b0-b012-4938-acbf-1286e74c832f None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:01.280407 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ed0b0-b012-4938-acbf-1286e74c832f None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:01.280693 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ed0b0-b012-4938-acbf-1286e74c832f None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:01.281415 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ed0b0-b012-4938-acbf-1286e74c832f None admin] RBAC: Adding query filter params (name=service) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:01.281726 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ed0b0-b012-4938-acbf-1286e74c832f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:01.283106 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ed0b0-b012-4938-acbf-1286e74c832f None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:01.291383 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 436/857] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 20:32:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:01.297280 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf858d9c-de7b-4a75-a766-159d565136d1 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:01.385504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:01.401675 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf858d9c-de7b-4a75-a766-159d565136d1 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:01.434443 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae69b3-e4d9-4ff6-9a9e-2294c7da31a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:01.435064 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae69b3-e4d9-4ff6-9a9e-2294c7da31a5 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:01.435335 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae69b3-e4d9-4ff6-9a9e-2294c7da31a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:01.435634 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae69b3-e4d9-4ff6-9a9e-2294c7da31a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:01.446938 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae69b3-e4d9-4ff6-9a9e-2294c7da31a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:01.448414 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae69b3-e4d9-4ff6-9a9e-2294c7da31a5 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:01.462752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-54ae69b3-e4d9-4ff6-9a9e-2294c7da31a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:32:01.462752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:01.462752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:01.462752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:01.462752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:01.462752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:01.462752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:01.462752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:01.462752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:01.462752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:01.462752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:01.462752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:01.462752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:32:01.462752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:32:01.462752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:32:01.462752 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:32:01.464010 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:01.464010 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:01.464010 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:01.464010 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:01.464010 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:01.464010 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:01.464010 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:01.464010 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:01.464010 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:01.464010 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:01.464010 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:01.464010 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:01.464010 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:01.464010 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:01.464010 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:01.464010 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:01.464010 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:32:01.464904 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:32:01.464904 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:32:01.464904 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:32:01.464904 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 422/858] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:32:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:32:01.469810 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ed0b0-b012-4938-acbf-1286e74c832f None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:01.576925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ed0b0-b012-4938-acbf-1286e74c832f None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:01.579280 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:01.613532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230ff9b-aac2-490b-9ea3-55ce7db137d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:01.614151 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230ff9b-aac2-490b-9ea3-55ce7db137d5 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:01.614430 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230ff9b-aac2-490b-9ea3-55ce7db137d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:01.614702 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230ff9b-aac2-490b-9ea3-55ce7db137d5 None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:01.615360 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230ff9b-aac2-490b-9ea3-55ce7db137d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:01.615702 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230ff9b-aac2-490b-9ea3-55ce7db137d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:01.620603 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230ff9b-aac2-490b-9ea3-55ce7db137d5 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:01.629243 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 437/859] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:01.635603 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae69b3-e4d9-4ff6-9a9e-2294c7da31a5 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:01.742442 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae69b3-e4d9-4ff6-9a9e-2294c7da31a5 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:01.776173 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24218ab-b0b6-48b9-b6e5-5ee80a579c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:01.776787 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24218ab-b0b6-48b9-b6e5-5ee80a579c86 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:01.777068 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24218ab-b0b6-48b9-b6e5-5ee80a579c86 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:01.777340 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24218ab-b0b6-48b9-b6e5-5ee80a579c86 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:01.779974 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:01.785704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24218ab-b0b6-48b9-b6e5-5ee80a579c86 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:01.787153 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24218ab-b0b6-48b9-b6e5-5ee80a579c86 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:01.798012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-c24218ab-b0b6-48b9-b6e5-5ee80a579c86 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:32:01.798012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:01.798012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:01.798012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:01.798012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:01.798012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:01.798012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:01.798012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:01.798012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:01.798012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:01.798012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:01.798012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:01.798012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:32:01.798012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:32:01.798012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:32:01.798012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:32:01.799204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:01.799204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:01.799204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:32:01.799204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:32:01.799204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:32:01.799204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:32:01.799204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:01.799204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:01.799204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:01.799204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:01.799204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:01.799204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:01.799204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:01.799204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:01.799204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:01.799204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:01.799204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:01.799204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:01.800208 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:01.800208 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:01.800208 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:32:01.800208 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:32:01.800208 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:32:01.800208 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:32:01.800208 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:32:01.800208 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:32:01.800208 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:32:01.800208 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:32:01.800208 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 423/860] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:32:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:32:01.805045 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230ff9b-aac2-490b-9ea3-55ce7db137d5 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:01.904349 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230ff9b-aac2-490b-9ea3-55ce7db137d5 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:01.939900 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe9ca8-f07a-44b7-a004-d54183fb06ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:01.940534 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe9ca8-f07a-44b7-a004-d54183fb06ab None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:01.940811 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe9ca8-f07a-44b7-a004-d54183fb06ab None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:01.941647 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe9ca8-f07a-44b7-a004-d54183fb06ab None admin] PATH_INFO: `/v3/users` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:01.942460 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe9ca8-f07a-44b7-a004-d54183fb06ab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:01.942767 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe9ca8-f07a-44b7-a004-d54183fb06ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:01.944272 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe9ca8-f07a-44b7-a004-d54183fb06ab None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:01.964274 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 438/861] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Aug 22 20:32:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:01.970527 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24218ab-b0b6-48b9-b6e5-5ee80a579c86 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:02.080914 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24218ab-b0b6-48b9-b6e5-5ee80a579c86 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:02.115082 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6152e-db74-45a7-9189-22fb8365e6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:02.115730 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6152e-db74-45a7-9189-22fb8365e6a7 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:02.116015 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6152e-db74-45a7-9189-22fb8365e6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:02.116316 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6152e-db74-45a7-9189-22fb8365e6a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:02.178042 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:02.184630 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6152e-db74-45a7-9189-22fb8365e6a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:02.186345 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6152e-db74-45a7-9189-22fb8365e6a7 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:02.287685 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 424/862] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:32:01 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:32:02.293898 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe9ca8-f07a-44b7-a004-d54183fb06ab None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:02.319327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:02.395920 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe9ca8-f07a-44b7-a004-d54183fb06ab None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:02.430315 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff4105-8af7-4671-83c0-e02308fef148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:02.430937 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff4105-8af7-4671-83c0-e02308fef148 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:02.431212 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff4105-8af7-4671-83c0-e02308fef148 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:02.431478 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff4105-8af7-4671-83c0-e02308fef148 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:02.442115 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff4105-8af7-4671-83c0-e02308fef148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:02.443564 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff4105-8af7-4671-83c0-e02308fef148 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:02.457933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-79ff4105-8af7-4671-83c0-e02308fef148 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:32:02.457933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:02.457933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:02.457933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:02.457933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:02.457933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:02.457933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:02.457933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:02.457933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:02.457933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:02.457933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:02.457933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:02.457933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:32:02.457933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:32:02.457933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:32:02.457933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:32:02.459523 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:02.459523 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:02.459523 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:02.459523 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:02.459523 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:02.459523 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:02.459523 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:02.459523 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:02.459523 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:02.459523 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:02.459523 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:02.459523 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:02.459523 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:02.459523 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:02.459523 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:02.459523 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:02.459523 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:32:02.460631 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:32:02.460631 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:32:02.460631 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:32:02.460631 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 439/863] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:32:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:32:02.465129 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6152e-db74-45a7-9189-22fb8365e6a7 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:02.562974 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:02.569475 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6152e-db74-45a7-9189-22fb8365e6a7 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:02.602951 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd791e-2158-4aa2-8bcb-cb5f64700820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:02.603573 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd791e-2158-4aa2-8bcb-cb5f64700820 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:02.603859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd791e-2158-4aa2-8bcb-cb5f64700820 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:02.604137 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd791e-2158-4aa2-8bcb-cb5f64700820 None admin] PATH_INFO: `/v3/domains` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:02.604782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd791e-2158-4aa2-8bcb-cb5f64700820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:02.605086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd791e-2158-4aa2-8bcb-cb5f64700820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:02.606461 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd791e-2158-4aa2-8bcb-cb5f64700820 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:02.618109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 425/864] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:02.623832 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff4105-8af7-4671-83c0-e02308fef148 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:02.703713 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:02.728185 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff4105-8af7-4671-83c0-e02308fef148 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:02.761576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea39fb-9dbb-41c5-8707-2887370e80b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:02.762202 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea39fb-9dbb-41c5-8707-2887370e80b5 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:02.762475 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea39fb-9dbb-41c5-8707-2887370e80b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:02.762744 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea39fb-9dbb-41c5-8707-2887370e80b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:02.769361 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea39fb-9dbb-41c5-8707-2887370e80b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:02.770794 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea39fb-9dbb-41c5-8707-2887370e80b5 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:02.781817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-56ea39fb-9dbb-41c5-8707-2887370e80b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:32:02.781817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:02.781817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:02.781817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:02.781817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:02.781817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:02.781817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:02.781817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:02.781817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:02.781817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:02.781817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:02.781817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:02.781817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:32:02.781817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:32:02.781817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:32:02.782854 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:32:02.782854 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:02.782854 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:02.782854 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:02.782854 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:02.782854 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:02.782854 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:02.782854 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:02.782854 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:02.782854 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:02.782854 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:02.782854 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:02.782854 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:02.782854 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:02.782854 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:02.782854 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:02.782854 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:02.784037 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:32:02.784037 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:32:02.784037 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:32:02.784037 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:32:02.784037 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:32:02.784037 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:32:02.784037 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:32:02.784037 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:32:02.784037 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 440/865] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:32:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:32:02.789743 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd791e-2158-4aa2-8bcb-cb5f64700820 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:02.889004 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd791e-2158-4aa2-8bcb-cb5f64700820 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:02.927376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9e154-e275-483f-a585-4377fb40ff3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:02.928036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9e154-e275-483f-a585-4377fb40ff3a None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:02.928312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9e154-e275-483f-a585-4377fb40ff3a None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:02.928582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9e154-e275-483f-a585-4377fb40ff3a None admin] PATH_INFO: `/v3/projects` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:02.929264 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9e154-e275-483f-a585-4377fb40ff3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:02.929564 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9e154-e275-483f-a585-4377fb40ff3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:02.930999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9e154-e275-483f-a585-4377fb40ff3a None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:02.943429 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 426/866] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 20:32:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:02.949838 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea39fb-9dbb-41c5-8707-2887370e80b5 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:03.054482 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea39fb-9dbb-41c5-8707-2887370e80b5 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:03.089547 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1343a-1c93-496a-a463-73f79b357d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:03.090187 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1343a-1c93-496a-a463-73f79b357d93 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:03.090468 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1343a-1c93-496a-a463-73f79b357d93 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:03.090746 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1343a-1c93-496a-a463-73f79b357d93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:03.091500 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1343a-1c93-496a-a463-73f79b357d93 None admin] RBAC: Adding query filter params (role.id=b92ee6686fe5412f9b7fdf27fb4c21d3, scope.project.id=7bda5c44ace24608b8ca69e9059d73ef, user.id=e4117090fe4047f9b6a2b5eab5ff218c) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:03.091839 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1343a-1c93-496a-a463-73f79b357d93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:03.093305 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1343a-1c93-496a-a463-73f79b357d93 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:03.095050 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:03.100297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 441/867] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:32:02 2022] GET /identity/v3/role_assignments?user.id=e4117090fe4047f9b6a2b5eab5ff218c&scope.project.id=7bda5c44ace24608b8ca69e9059d73ef&role.id=b92ee6686fe5412f9b7fdf27fb4c21d3 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:05.353545 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170ee36-94ee-4b9d-8427-281c9321730c None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:05.354138 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170ee36-94ee-4b9d-8427-281c9321730c None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:05.354138 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170ee36-94ee-4b9d-8427-281c9321730c None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:05.355423 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 427/868] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:32:05.360870 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1f924-f397-4a09-bcc8-a35ee7b68db6 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:05.361478 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1f924-f397-4a09-bcc8-a35ee7b68db6 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:05.361478 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1f924-f397-4a09-bcc8-a35ee7b68db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:05.381236 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-66a1f924-f397-4a09-bcc8-a35ee7b68db6 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:32:05.382497 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-66a1f924-f397-4a09-bcc8-a35ee7b68db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:32:05.451841 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 442/869] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:32:05 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:32:05.780049 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170ee36-94ee-4b9d-8427-281c9321730c None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:05.799811 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:05.889875 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170ee36-94ee-4b9d-8427-281c9321730c None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:05.924368 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bec5e-6c27-4562-b6fb-d6930c6717ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:05.925783 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bec5e-6c27-4562-b6fb-d6930c6717ee None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:05.926068 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bec5e-6c27-4562-b6fb-d6930c6717ee None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:05.926334 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bec5e-6c27-4562-b6fb-d6930c6717ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:05.937833 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bec5e-6c27-4562-b6fb-d6930c6717ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:32:05.942534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-f86bec5e-6c27-4562-b6fb-d6930c6717ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:32:05.942534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:05.942534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:05.942534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:05.942534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:05.942534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:05.942534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:05.942534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:05.942534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:05.942534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:05.942534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:05.942534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:05.942534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:32:05.942534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:32:05.942534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:32:05.942534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:32:05.949190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:32:05.949190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:32:05.949190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:32:05.949190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:32:05.949190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:05.949190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:05.949190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:05.949190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:05.949190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:05.949190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:05.949190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:05.949190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:05.949190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:05.949190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:05.949190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:05.949190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:05.950062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:05.950062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:05.950062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:05.950062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:05.950062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:32:05.950062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:32:05.950062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:32:05.950062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:32:05.950062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:32:05.950062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:32:05.950062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:32:05.950062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:32:05.950062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 428/870] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 20:32:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:32:05.950771 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1f924-f397-4a09-bcc8-a35ee7b68db6 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:06.053514 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1f924-f397-4a09-bcc8-a35ee7b68db6 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:06.080406 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:06.088707 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba623e3-2e23-410e-968c-4224731d7ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:06.089309 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba623e3-2e23-410e-968c-4224731d7ea6 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:06.089637 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba623e3-2e23-410e-968c-4224731d7ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:06.089903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba623e3-2e23-410e-968c-4224731d7ea6 None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:06.090567 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba623e3-2e23-410e-968c-4224731d7ea6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:06.090871 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba623e3-2e23-410e-968c-4224731d7ea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:06.092269 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba623e3-2e23-410e-968c-4224731d7ea6 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:06.101099 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 443/871] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:32:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:06.107110 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bec5e-6c27-4562-b6fb-d6930c6717ee None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:06.193091 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:06.219813 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bec5e-6c27-4562-b6fb-d6930c6717ee None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:06.253792 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd2182-9a2e-4e15-9923-0bffff26377c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:06.254418 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd2182-9a2e-4e15-9923-0bffff26377c None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:06.254702 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd2182-9a2e-4e15-9923-0bffff26377c None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:06.254979 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd2182-9a2e-4e15-9923-0bffff26377c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:06.265502 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd2182-9a2e-4e15-9923-0bffff26377c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:06.266959 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd2182-9a2e-4e15-9923-0bffff26377c None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:06.282124 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-71fd2182-9a2e-4e15-9923-0bffff26377c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:32:06.282124 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:06.282124 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:06.282124 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:06.282124 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:06.282124 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:06.282124 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:06.282124 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:06.282124 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:06.282124 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:06.282124 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:06.282124 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:06.282124 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:32:06.282124 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:32:06.282124 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:32:06.282124 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:32:06.283379 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:06.283379 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:06.283379 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:06.283379 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:06.283379 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:06.283379 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:06.283379 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:06.283379 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:06.283379 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:06.283379 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:06.283379 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:06.283379 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:06.283379 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:06.283379 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:06.283379 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:06.283379 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:06.283379 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:32:06.284513 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:32:06.284513 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:32:06.284513 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:32:06.284513 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 429/872] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:32:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:32:06.290048 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba623e3-2e23-410e-968c-4224731d7ea6 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:06.402040 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba623e3-2e23-410e-968c-4224731d7ea6 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:06.441460 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ede919-8888-4f06-9d60-d9a1c698bb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:06.441460 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ede919-8888-4f06-9d60-d9a1c698bb5c None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:06.441761 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ede919-8888-4f06-9d60-d9a1c698bb5c None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:06.441938 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ede919-8888-4f06-9d60-d9a1c698bb5c None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:06.442578 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ede919-8888-4f06-9d60-d9a1c698bb5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:06.442887 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ede919-8888-4f06-9d60-d9a1c698bb5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:06.444272 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ede919-8888-4f06-9d60-d9a1c698bb5c None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:06.456195 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 444/873] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:06.463873 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd2182-9a2e-4e15-9923-0bffff26377c None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:06.567933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd2182-9a2e-4e15-9923-0bffff26377c None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:06.594502 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:06.602562 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a5cca-ede4-4e34-b010-5350498783cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:06.603197 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a5cca-ede4-4e34-b010-5350498783cf None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:06.603479 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a5cca-ede4-4e34-b010-5350498783cf None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:06.603788 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a5cca-ede4-4e34-b010-5350498783cf None admin] PATH_INFO: `/v3/users/placement` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:06.611624 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a5cca-ede4-4e34-b010-5350498783cf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:06.613121 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a5cca-ede4-4e34-b010-5350498783cf None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:06.624608 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-821a5cca-ede4-4e34-b010-5350498783cf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:32:06.624608 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:06.624608 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:06.624608 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:06.624608 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:06.624608 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:06.624608 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:06.624608 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:06.624608 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:06.624608 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:06.624608 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:06.624608 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:06.624608 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:32:06.624608 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:32:06.624608 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:32:06.624608 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:32:06.625806 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:06.625806 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:06.625806 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:32:06.625806 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:32:06.625806 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:32:06.625806 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:32:06.625806 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:06.625806 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:06.625806 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:06.625806 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:06.625806 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:06.625806 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:06.625806 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:06.625806 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:06.625806 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:06.625806 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:06.625806 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:06.625806 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:06.626826 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:06.626826 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:06.626826 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:32:06.626826 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:32:06.626826 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:32:06.626826 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:32:06.626826 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:32:06.626826 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:32:06.626826 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:32:06.626826 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:32:06.626826 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 430/874] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:32:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:32:06.632295 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ede919-8888-4f06-9d60-d9a1c698bb5c None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:06.683836 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:06.734299 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ede919-8888-4f06-9d60-d9a1c698bb5c None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:06.768627 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bb53b-488e-4734-a5ed-789b9d9319d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:06.770339 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bb53b-488e-4734-a5ed-789b9d9319d8 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:06.770339 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bb53b-488e-4734-a5ed-789b9d9319d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:06.770535 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bb53b-488e-4734-a5ed-789b9d9319d8 None admin] PATH_INFO: `/v3/users` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:06.771144 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973bb53b-488e-4734-a5ed-789b9d9319d8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:06.771433 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973bb53b-488e-4734-a5ed-789b9d9319d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:06.772928 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973bb53b-488e-4734-a5ed-789b9d9319d8 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:06.790260 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 445/875] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Aug 22 20:32:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:06.796250 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a5cca-ede4-4e34-b010-5350498783cf None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:06.903513 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a5cca-ede4-4e34-b010-5350498783cf None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:06.941338 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdf5e4-ddcb-46f6-b3e3-3a132e9bad89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:06.941338 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdf5e4-ddcb-46f6-b3e3-3a132e9bad89 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:06.941338 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdf5e4-ddcb-46f6-b3e3-3a132e9bad89 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:06.941338 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdf5e4-ddcb-46f6-b3e3-3a132e9bad89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:06.995628 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:07.008104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdf5e4-ddcb-46f6-b3e3-3a132e9bad89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:07.009566 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdf5e4-ddcb-46f6-b3e3-3a132e9bad89 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:07.104316 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 431/876] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:32:06 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:32:07.110453 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bb53b-488e-4734-a5ed-789b9d9319d8 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:07.210756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bb53b-488e-4734-a5ed-789b9d9319d8 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:07.220925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:07.247079 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cded17-6375-4781-901d-6b3776be7b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:07.247744 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cded17-6375-4781-901d-6b3776be7b2d None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:07.248023 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cded17-6375-4781-901d-6b3776be7b2d None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:07.248293 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cded17-6375-4781-901d-6b3776be7b2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:07.258397 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cded17-6375-4781-901d-6b3776be7b2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:07.259887 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cded17-6375-4781-901d-6b3776be7b2d None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:07.275062 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-20cded17-6375-4781-901d-6b3776be7b2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:32:07.275062 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:07.275062 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:07.275062 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:07.275062 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:07.275062 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:07.275062 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:07.275062 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:07.275062 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:07.275062 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:07.275062 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:07.275062 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:07.275062 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:32:07.275062 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:32:07.275062 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:32:07.275062 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:32:07.276297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:07.276297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:07.276297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:07.276297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:07.276297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:07.276297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:07.276297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:07.276297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:07.276297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:07.276297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:07.276297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:07.276297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:07.276297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:07.276297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:07.276297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:07.276297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:07.276297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:32:07.277313 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:32:07.277313 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:32:07.277313 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:32:07.277313 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 446/877] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:32:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:32:07.282534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdf5e4-ddcb-46f6-b3e3-3a132e9bad89 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:07.372099 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:07.385715 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdf5e4-ddcb-46f6-b3e3-3a132e9bad89 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:07.420028 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163737e4-77e0-4c94-ba68-7b0d64bfc4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:07.420627 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163737e4-77e0-4c94-ba68-7b0d64bfc4fa None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:07.420908 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163737e4-77e0-4c94-ba68-7b0d64bfc4fa None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:07.421208 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163737e4-77e0-4c94-ba68-7b0d64bfc4fa None admin] PATH_INFO: `/v3/domains` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:07.421868 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163737e4-77e0-4c94-ba68-7b0d64bfc4fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:07.422260 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163737e4-77e0-4c94-ba68-7b0d64bfc4fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:07.423682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163737e4-77e0-4c94-ba68-7b0d64bfc4fa None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:07.435465 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 432/878] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:07.442268 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cded17-6375-4781-901d-6b3776be7b2d None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:07.543883 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cded17-6375-4781-901d-6b3776be7b2d None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:07.578339 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43909977-4c39-4e82-a0df-727dd3b4f016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:07.578977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43909977-4c39-4e82-a0df-727dd3b4f016 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:07.582742 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43909977-4c39-4e82-a0df-727dd3b4f016 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:07.582742 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43909977-4c39-4e82-a0df-727dd3b4f016 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:07.587185 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43909977-4c39-4e82-a0df-727dd3b4f016 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:07.588706 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43909977-4c39-4e82-a0df-727dd3b4f016 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:07.600446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-43909977-4c39-4e82-a0df-727dd3b4f016 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:32:07.600446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:07.600446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:07.600446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:07.600446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:07.600446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:07.600446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:07.600446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:07.600446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:07.600446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:07.600446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:07.600446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:07.600446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:32:07.600446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:32:07.600446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:32:07.601519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:32:07.601519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:07.601519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:07.601519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:07.601519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:07.601519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:07.601519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:07.601519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:07.601519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:07.601519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:07.601519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:07.601519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:07.601519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:07.601519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:07.601519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:07.601519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:07.601519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:07.602650 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:32:07.602650 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:32:07.602650 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:32:07.602650 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:32:07.602650 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:32:07.602650 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:32:07.602650 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:32:07.602650 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:32:07.602650 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 447/879] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:32:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:32:07.608160 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163737e4-77e0-4c94-ba68-7b0d64bfc4fa None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:07.709140 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163737e4-77e0-4c94-ba68-7b0d64bfc4fa None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:07.742548 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5026c0-00a1-4f99-a5ae-26651fe709ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:07.743154 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5026c0-00a1-4f99-a5ae-26651fe709ed None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:07.743436 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5026c0-00a1-4f99-a5ae-26651fe709ed None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:07.743740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5026c0-00a1-4f99-a5ae-26651fe709ed None admin] PATH_INFO: `/v3/projects` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:07.744428 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5026c0-00a1-4f99-a5ae-26651fe709ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:07.744735 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5026c0-00a1-4f99-a5ae-26651fe709ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:07.746169 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5026c0-00a1-4f99-a5ae-26651fe709ed None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:07.758168 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 433/880] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 20:32:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:07.765152 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43909977-4c39-4e82-a0df-727dd3b4f016 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:07.806145 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:07.867134 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43909977-4c39-4e82-a0df-727dd3b4f016 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:07.907969 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e7e17-e767-425e-839d-fc7b21e005b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:07.908580 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e7e17-e767-425e-839d-fc7b21e005b3 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:07.908862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e7e17-e767-425e-839d-fc7b21e005b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:07.909137 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e7e17-e767-425e-839d-fc7b21e005b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:07.910472 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e7e17-e767-425e-839d-fc7b21e005b3 None admin] RBAC: Adding query filter params (role.id=1e3ce9c8b9934a7bb515b39e21fc1d68, scope.project.id=7bda5c44ace24608b8ca69e9059d73ef, user.id=e4117090fe4047f9b6a2b5eab5ff218c) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:07.910783 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e7e17-e767-425e-839d-fc7b21e005b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:07.912242 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e7e17-e767-425e-839d-fc7b21e005b3 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:07.921336 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 448/881] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:32:07 2022] GET /identity/v3/role_assignments?user.id=e4117090fe4047f9b6a2b5eab5ff218c&scope.project.id=7bda5c44ace24608b8ca69e9059d73ef&role.id=1e3ce9c8b9934a7bb515b39e21fc1d68 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:10.100203 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7b9eb-89c2-4f21-b182-07c5b98a5e3c None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:10.100733 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7b9eb-89c2-4f21-b182-07c5b98a5e3c None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:10.100846 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7b9eb-89c2-4f21-b182-07c5b98a5e3c None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:10.102303 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 434/882] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:32:10.108152 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de721e4-56b0-4ab7-aecf-83896e0aeab7 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:10.108543 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de721e4-56b0-4ab7-aecf-83896e0aeab7 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:10.108703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de721e4-56b0-4ab7-aecf-83896e0aeab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:10.126619 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-9de721e4-56b0-4ab7-aecf-83896e0aeab7 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:32:10.128321 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-9de721e4-56b0-4ab7-aecf-83896e0aeab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:32:10.194216 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 449/883] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:32:10 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:32:10.517638 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7b9eb-89c2-4f21-b182-07c5b98a5e3c None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:10.530010 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:10.619277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7b9eb-89c2-4f21-b182-07c5b98a5e3c None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:10.654444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446cf59-72b1-498f-a467-94196c601f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:10.655068 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446cf59-72b1-498f-a467-94196c601f2e None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:10.655350 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446cf59-72b1-498f-a467-94196c601f2e None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:10.655655 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446cf59-72b1-498f-a467-94196c601f2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:10.665769 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446cf59-72b1-498f-a467-94196c601f2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:32:10.670431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-5446cf59-72b1-498f-a467-94196c601f2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:32:10.670431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:10.670431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:10.670431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:10.670431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:10.670431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:10.670431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:10.670431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:10.670431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:10.670431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:10.670431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:10.670431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:10.670431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:32:10.670431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:32:10.670431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:32:10.670431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:32:10.671494 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:32:10.671494 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:32:10.671494 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:32:10.671494 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:32:10.671494 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:10.671494 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:10.671494 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:10.671494 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:10.671494 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:10.671494 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:10.671494 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:10.671494 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:10.671494 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:10.671494 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:10.671494 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:10.671494 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:10.672721 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:10.672721 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:10.672721 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:10.672721 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:10.672721 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:32:10.672721 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:32:10.672721 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:32:10.672721 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:32:10.672721 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:32:10.672721 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:32:10.672721 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:32:10.672721 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:32:10.672721 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 435/884] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 20:32:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:32:10.678346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de721e4-56b0-4ab7-aecf-83896e0aeab7 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:10.694291 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:10.778087 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de721e4-56b0-4ab7-aecf-83896e0aeab7 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:10.814932 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f4a6b-4ede-4fa2-b812-62cc107f54db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:10.816207 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f4a6b-4ede-4fa2-b812-62cc107f54db None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:10.816493 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f4a6b-4ede-4fa2-b812-62cc107f54db None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:10.816770 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f4a6b-4ede-4fa2-b812-62cc107f54db None admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:10.817444 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f4a6b-4ede-4fa2-b812-62cc107f54db None admin] RBAC: Adding query filter params (name=admin) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:10.817751 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f4a6b-4ede-4fa2-b812-62cc107f54db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:10.819119 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f4a6b-4ede-4fa2-b812-62cc107f54db None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:10.828007 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 450/885] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:32:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:10.834349 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446cf59-72b1-498f-a467-94196c601f2e None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:10.911264 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:10.950210 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446cf59-72b1-498f-a467-94196c601f2e None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:10.985734 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57b3cc-75a6-460c-b078-1a4ee72b16a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:10.986356 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57b3cc-75a6-460c-b078-1a4ee72b16a0 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:10.986635 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57b3cc-75a6-460c-b078-1a4ee72b16a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:10.986907 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57b3cc-75a6-460c-b078-1a4ee72b16a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:10.998179 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57b3cc-75a6-460c-b078-1a4ee72b16a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:10.999689 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57b3cc-75a6-460c-b078-1a4ee72b16a0 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:11.013808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-9e57b3cc-75a6-460c-b078-1a4ee72b16a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:32:11.013808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:11.013808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:11.013808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:11.013808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:11.013808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:11.013808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:11.013808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:11.013808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:11.013808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:11.013808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:11.013808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:11.013808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:32:11.013808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:32:11.013808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:32:11.013808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:32:11.014947 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:11.014947 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:11.014947 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:11.014947 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:11.014947 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:11.014947 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:11.014947 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:11.014947 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:11.014947 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:11.014947 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:11.014947 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:11.014947 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:11.014947 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:11.014947 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:11.014947 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:11.014947 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:11.014947 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:32:11.016051 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:32:11.016051 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:32:11.016051 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:32:11.016051 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 436/886] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:32:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:32:11.020976 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f4a6b-4ede-4fa2-b812-62cc107f54db None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:11.099307 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:11.121676 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f4a6b-4ede-4fa2-b812-62cc107f54db None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:11.154831 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3779d-5445-467b-8733-56a902ec60d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:11.155426 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3779d-5445-467b-8733-56a902ec60d0 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:11.155730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3779d-5445-467b-8733-56a902ec60d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:11.156027 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3779d-5445-467b-8733-56a902ec60d0 None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:11.156668 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3779d-5445-467b-8733-56a902ec60d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:11.156967 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3779d-5445-467b-8733-56a902ec60d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:11.158370 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3779d-5445-467b-8733-56a902ec60d0 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:11.170487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 451/887] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:11.177111 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57b3cc-75a6-460c-b078-1a4ee72b16a0 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:11.278107 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57b3cc-75a6-460c-b078-1a4ee72b16a0 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:11.298698 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:11.313279 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06486f56-a6e2-4756-acce-479751423fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:11.313907 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06486f56-a6e2-4756-acce-479751423fa4 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:11.314186 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06486f56-a6e2-4756-acce-479751423fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:11.314485 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06486f56-a6e2-4756-acce-479751423fa4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:11.322827 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06486f56-a6e2-4756-acce-479751423fa4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:11.326650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06486f56-a6e2-4756-acce-479751423fa4 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:11.336100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-06486f56-a6e2-4756-acce-479751423fa4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:32:11.336100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:11.336100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:11.336100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:11.336100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:11.336100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:11.336100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:11.336100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:11.336100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:11.336100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:11.336100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:11.336100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:11.336100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:32:11.336100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:32:11.336100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:32:11.336100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:32:11.337036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:11.337036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:11.337036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:32:11.337036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:32:11.337036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:32:11.337036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:32:11.337036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:11.337036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:11.337036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:11.337036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:11.337036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:11.337036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:11.337036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:11.337036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:11.337036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:11.337036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:11.337036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:11.337036 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:11.338321 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:11.338321 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:11.338321 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:32:11.338321 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:32:11.338321 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:32:11.338321 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:32:11.338321 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:32:11.338321 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:32:11.338321 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:32:11.338321 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:32:11.338321 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 437/888] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:32:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:32:11.343148 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3779d-5445-467b-8733-56a902ec60d0 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:11.445410 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3779d-5445-467b-8733-56a902ec60d0 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:11.479626 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b4f91-67f0-40c6-b683-98c2cb38a4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:11.480268 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b4f91-67f0-40c6-b683-98c2cb38a4ae None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:11.480541 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b4f91-67f0-40c6-b683-98c2cb38a4ae None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:11.480807 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b4f91-67f0-40c6-b683-98c2cb38a4ae None admin] PATH_INFO: `/v3/users` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:11.481534 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b4f91-67f0-40c6-b683-98c2cb38a4ae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:11.481836 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b4f91-67f0-40c6-b683-98c2cb38a4ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:11.483251 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b4f91-67f0-40c6-b683-98c2cb38a4ae None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:11.485792 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:11.500258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 452/889] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Aug 22 20:32:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:11.506197 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06486f56-a6e2-4756-acce-479751423fa4 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:11.610334 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06486f56-a6e2-4756-acce-479751423fa4 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:11.646572 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29855416-9ca8-4f2c-a98c-2ea6b71dcc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:11.647214 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29855416-9ca8-4f2c-a98c-2ea6b71dcc52 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:11.647491 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29855416-9ca8-4f2c-a98c-2ea6b71dcc52 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:11.647808 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29855416-9ca8-4f2c-a98c-2ea6b71dcc52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:11.660758 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29855416-9ca8-4f2c-a98c-2ea6b71dcc52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:11.662283 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29855416-9ca8-4f2c-a98c-2ea6b71dcc52 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:11.678141 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-29855416-9ca8-4f2c-a98c-2ea6b71dcc52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:32:11.678141 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:11.678141 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:11.678141 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:11.678141 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:11.678141 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:11.678141 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:11.678141 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:11.678141 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:11.678141 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:11.678141 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:11.678141 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:11.678141 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:32:11.678141 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:32:11.678141 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:32:11.678141 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:32:11.679450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:11.679450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:11.679450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:11.679450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:11.679450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:11.679450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:11.679450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:11.679450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:11.679450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:11.679450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:11.679450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:11.679450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:11.679450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:11.679450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:11.679450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:11.679450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:11.679450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:32:11.680433 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:32:11.680433 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:32:11.680433 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:32:11.680433 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 438/890] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:32:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:32:11.685665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b4f91-67f0-40c6-b683-98c2cb38a4ae None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:11.793555 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b4f91-67f0-40c6-b683-98c2cb38a4ae None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:11.829472 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d581763-0036-47d0-abc0-e642d5fc7c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:11.830091 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d581763-0036-47d0-abc0-e642d5fc7c03 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:11.830350 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d581763-0036-47d0-abc0-e642d5fc7c03 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:11.830617 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d581763-0036-47d0-abc0-e642d5fc7c03 None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:11.831896 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d581763-0036-47d0-abc0-e642d5fc7c03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:11.832313 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d581763-0036-47d0-abc0-e642d5fc7c03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:11.833681 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d581763-0036-47d0-abc0-e642d5fc7c03 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:11.845396 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 453/891] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:11.851141 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29855416-9ca8-4f2c-a98c-2ea6b71dcc52 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:11.884104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:11.954027 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29855416-9ca8-4f2c-a98c-2ea6b71dcc52 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:11.996302 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465a05d-a075-430e-a39b-da89622970fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:11.996934 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465a05d-a075-430e-a39b-da89622970fd None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:11.997217 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465a05d-a075-430e-a39b-da89622970fd None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:11.997493 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465a05d-a075-430e-a39b-da89622970fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:12.005086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465a05d-a075-430e-a39b-da89622970fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:12.006559 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465a05d-a075-430e-a39b-da89622970fd None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:12.019442 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-0465a05d-a075-430e-a39b-da89622970fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:32:12.019442 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:12.019442 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:12.019442 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:12.019442 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:12.019442 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:12.019442 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:12.019442 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:12.019442 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:12.019442 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:12.019442 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:12.019442 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:12.019442 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:32:12.019442 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:32:12.019442 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:32:12.022003 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:32:12.022003 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:12.022003 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:12.022003 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:12.022003 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:12.022003 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:12.022003 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:12.022003 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:12.022003 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:12.022003 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:12.022003 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:12.022003 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:12.022003 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:12.022003 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:12.022003 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:12.022003 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:12.022003 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:12.022974 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:32:12.022974 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:32:12.022974 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:32:12.022974 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:32:12.022974 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:32:12.022974 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:32:12.022974 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:32:12.022974 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:32:12.022974 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 439/892] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:32:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:32:12.026764 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d581763-0036-47d0-abc0-e642d5fc7c03 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:12.084503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:12.129839 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d581763-0036-47d0-abc0-e642d5fc7c03 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:12.162864 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95132de5-05d6-425c-865a-2ce4d6459e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:12.163474 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95132de5-05d6-425c-865a-2ce4d6459e19 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:12.163785 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95132de5-05d6-425c-865a-2ce4d6459e19 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:12.164062 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95132de5-05d6-425c-865a-2ce4d6459e19 None admin] PATH_INFO: `/v3/projects` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:12.164759 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95132de5-05d6-425c-865a-2ce4d6459e19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:12.165073 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95132de5-05d6-425c-865a-2ce4d6459e19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:12.166499 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95132de5-05d6-425c-865a-2ce4d6459e19 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:12.179332 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 454/893] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 20:32:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:32:12.185661 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465a05d-a075-430e-a39b-da89622970fd None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:12.276820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:12.285907 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465a05d-a075-430e-a39b-da89622970fd None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:12.325422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2132e-996c-43c9-acfe-db74faf92592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:12.326072 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2132e-996c-43c9-acfe-db74faf92592 None admin] REQUEST_METHOD: `PUT` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:12.326346 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2132e-996c-43c9-acfe-db74faf92592 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:12.326614 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2132e-996c-43c9-acfe-db74faf92592 None admin] PATH_INFO: `/v3/projects/7bda5c44ace24608b8ca69e9059d73ef/users/e4117090fe4047f9b6a2b5eab5ff218c/roles/1e3ce9c8b9934a7bb515b39e21fc1d68` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:12.328500 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2132e-996c-43c9-acfe-db74faf92592 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bda5c44ace24608b8ca69e9059d73ef, user_id=e4117090fe4047f9b6a2b5eab5ff218c, role_id=1e3ce9c8b9934a7bb515b39e21fc1d68)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:12.329933 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2132e-996c-43c9-acfe-db74faf92592 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:12.533047 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 440/894] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 20:32:12 2022] PUT /identity/v3/projects/7bda5c44ace24608b8ca69e9059d73ef/users/e4117090fe4047f9b6a2b5eab5ff218c/roles/1e3ce9c8b9934a7bb515b39e21fc1d68 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:32:14.767720 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4ca76-ddad-49d8-8360-8915bb18de6e None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:14.768319 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4ca76-ddad-49d8-8360-8915bb18de6e None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:14.769027 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4ca76-ddad-49d8-8360-8915bb18de6e None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:14.770217 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 455/895] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:32:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:32:14.775452 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031b512-498f-477c-8ffe-2fa92f89c308 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:14.775901 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031b512-498f-477c-8ffe-2fa92f89c308 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:14.776034 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031b512-498f-477c-8ffe-2fa92f89c308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:14.794134 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-2031b512-498f-477c-8ffe-2fa92f89c308 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:32:14.795329 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-2031b512-498f-477c-8ffe-2fa92f89c308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:32:14.862901 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 441/896] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:32:14 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:32:15.185510 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4ca76-ddad-49d8-8360-8915bb18de6e None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:15.295336 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4ca76-ddad-49d8-8360-8915bb18de6e None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:15.310340 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:15.330869 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda66afe-6cfa-4af5-a873-bf6d9f85896b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:15.331499 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda66afe-6cfa-4af5-a873-bf6d9f85896b None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:15.331803 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda66afe-6cfa-4af5-a873-bf6d9f85896b None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:15.332093 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda66afe-6cfa-4af5-a873-bf6d9f85896b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:15.341850 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda66afe-6cfa-4af5-a873-bf6d9f85896b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:32:15.346530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-fda66afe-6cfa-4af5-a873-bf6d9f85896b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:32:15.346530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:15.346530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:15.346530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:15.346530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:15.346530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:15.346530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:15.346530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:15.346530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:15.346530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:15.346530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:15.346530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:15.346530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:32:15.346530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:32:15.346530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:32:15.346530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:32:15.347704 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:32:15.347704 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:32:15.347704 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:32:15.347704 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:32:15.347704 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:15.347704 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:15.347704 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:15.347704 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:15.347704 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:15.347704 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:15.347704 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:15.347704 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:15.347704 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:15.347704 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:15.347704 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:15.347704 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:15.348806 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:15.348806 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:15.348806 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:15.348806 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:15.348806 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:32:15.348806 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:32:15.348806 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:32:15.348806 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:32:15.348806 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:32:15.348806 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:32:15.348806 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:32:15.348806 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:32:15.348806 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 456/897] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 20:32:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:32:15.353654 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031b512-498f-477c-8ffe-2fa92f89c308 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:15.436667 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:15.455823 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031b512-498f-477c-8ffe-2fa92f89c308 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:15.490243 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d2f9e-62b9-4131-8905-0221db628fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:15.490878 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d2f9e-62b9-4131-8905-0221db628fce None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:15.491158 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d2f9e-62b9-4131-8905-0221db628fce None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:15.491432 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d2f9e-62b9-4131-8905-0221db628fce None admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:15.492187 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d2f9e-62b9-4131-8905-0221db628fce None admin] RBAC: Adding query filter params (name=admin) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:15.492523 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d2f9e-62b9-4131-8905-0221db628fce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:15.493901 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d2f9e-62b9-4131-8905-0221db628fce None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:15.501733 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 442/898] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 20:32:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:32:15.507695 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda66afe-6cfa-4af5-a873-bf6d9f85896b None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:15.613496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda66afe-6cfa-4af5-a873-bf6d9f85896b None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:15.647539 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968f8e3-ac32-49e6-b7f7-fddbe70baa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:15.648197 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968f8e3-ac32-49e6-b7f7-fddbe70baa16 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:15.648482 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968f8e3-ac32-49e6-b7f7-fddbe70baa16 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:15.648757 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968f8e3-ac32-49e6-b7f7-fddbe70baa16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:15.662174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968f8e3-ac32-49e6-b7f7-fddbe70baa16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:15.663719 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968f8e3-ac32-49e6-b7f7-fddbe70baa16 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:15.679278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-e968f8e3-ac32-49e6-b7f7-fddbe70baa16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:32:15.679278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:15.679278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:15.679278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:15.679278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:15.679278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:15.679278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:15.679278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:15.679278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:15.679278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:15.679278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:15.679278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:15.679278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:32:15.679278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:32:15.679278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:32:15.679278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:32:15.685220 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:15.685220 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:15.685220 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:15.685220 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:15.685220 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:15.685220 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:15.685220 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:15.685220 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:15.685220 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:15.685220 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:15.685220 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:15.685220 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:15.685220 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:15.685220 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:15.685220 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:15.685220 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:15.685220 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:32:15.686403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:32:15.686403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:32:15.686403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:32:15.686403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 457/899] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:32:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:32:15.686804 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d2f9e-62b9-4131-8905-0221db628fce None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:15.785834 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d2f9e-62b9-4131-8905-0221db628fce None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:15.819660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98f4db-2afb-4095-b9a8-3cc52be84698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:15.820277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98f4db-2afb-4095-b9a8-3cc52be84698 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:15.820560 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98f4db-2afb-4095-b9a8-3cc52be84698 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:15.820821 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98f4db-2afb-4095-b9a8-3cc52be84698 None admin] PATH_INFO: `/v3/domains` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:15.821458 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98f4db-2afb-4095-b9a8-3cc52be84698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:15.821757 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98f4db-2afb-4095-b9a8-3cc52be84698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:15.823128 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98f4db-2afb-4095-b9a8-3cc52be84698 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:15.835962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 443/900] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:15.841858 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968f8e3-ac32-49e6-b7f7-fddbe70baa16 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:15.870338 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:15.942618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968f8e3-ac32-49e6-b7f7-fddbe70baa16 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:15.976304 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c2130-2a9e-4b71-8201-b4e44afcfea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:15.976934 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c2130-2a9e-4b71-8201-b4e44afcfea4 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:15.977213 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c2130-2a9e-4b71-8201-b4e44afcfea4 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:15.977486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c2130-2a9e-4b71-8201-b4e44afcfea4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:15.984614 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c2130-2a9e-4b71-8201-b4e44afcfea4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:15.986051 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c2130-2a9e-4b71-8201-b4e44afcfea4 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:15.998366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-265c2130-2a9e-4b71-8201-b4e44afcfea4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:32:15.998366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:15.998366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:15.998366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:15.998366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:15.998366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:15.998366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:15.998366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:15.998366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:15.998366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:15.998366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:15.998366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:15.998366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:32:15.998366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:32:15.998366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:32:15.998366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:32:15.999561 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:15.999561 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:15.999561 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:32:15.999561 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:32:15.999561 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:32:15.999561 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:32:15.999561 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:15.999561 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:15.999561 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:15.999561 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:15.999561 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:15.999561 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:15.999561 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:15.999561 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:15.999561 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:15.999561 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:15.999561 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:15.999561 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:16.000890 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:16.000890 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:16.000890 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:32:16.000890 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:32:16.000890 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:32:16.000890 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:32:16.000890 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:32:16.000890 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:32:16.000890 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:32:16.000890 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:32:16.000890 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 458/901] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:32:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:32:16.005553 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98f4db-2afb-4095-b9a8-3cc52be84698 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:16.009459 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:16.105557 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98f4db-2afb-4095-b9a8-3cc52be84698 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:16.140590 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2a37f-38ef-4d50-b9c7-35f196a395fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:16.143863 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2a37f-38ef-4d50-b9c7-35f196a395fe None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:16.143863 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2a37f-38ef-4d50-b9c7-35f196a395fe None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:16.143863 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2a37f-38ef-4d50-b9c7-35f196a395fe None admin] PATH_INFO: `/v3/users` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:16.143863 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2a37f-38ef-4d50-b9c7-35f196a395fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:16.143863 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2a37f-38ef-4d50-b9c7-35f196a395fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:16.144805 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2a37f-38ef-4d50-b9c7-35f196a395fe None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:16.164512 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 444/902] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Aug 22 20:32:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:16.170486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c2130-2a9e-4b71-8201-b4e44afcfea4 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:16.265445 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:16.281956 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c2130-2a9e-4b71-8201-b4e44afcfea4 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:16.317999 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c080ab8-58cc-4df4-9885-673549933ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:16.318643 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c080ab8-58cc-4df4-9885-673549933ee5 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:16.318926 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c080ab8-58cc-4df4-9885-673549933ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:16.319256 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c080ab8-58cc-4df4-9885-673549933ee5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:16.390236 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c080ab8-58cc-4df4-9885-673549933ee5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:16.391740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c080ab8-58cc-4df4-9885-673549933ee5 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:16.497140 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:16.497140 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 459/903] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 20:32:16 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:32:16.500857 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2a37f-38ef-4d50-b9c7-35f196a395fe None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:16.566703 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:16.604709 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2a37f-38ef-4d50-b9c7-35f196a395fe None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:16.640348 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be3d71-0686-4dfa-a3e1-2f1634cdbf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:16.641014 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be3d71-0686-4dfa-a3e1-2f1634cdbf97 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:16.641339 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be3d71-0686-4dfa-a3e1-2f1634cdbf97 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:16.641609 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be3d71-0686-4dfa-a3e1-2f1634cdbf97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:16.651890 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be3d71-0686-4dfa-a3e1-2f1634cdbf97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:16.653462 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be3d71-0686-4dfa-a3e1-2f1634cdbf97 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:16.668012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-a9be3d71-0686-4dfa-a3e1-2f1634cdbf97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:32:16.668012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:16.668012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:16.668012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:16.668012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:16.668012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:16.668012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:16.668012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:16.668012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:16.668012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:16.668012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:16.668012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:16.668012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:32:16.668012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:32:16.668012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:32:16.668012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:32:16.669104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:16.669104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:16.669104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:16.669104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:16.669104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:16.669104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:16.669104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:16.669104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:16.669104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:16.669104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:16.669104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:16.669104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:16.669104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:16.669104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:16.669104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:16.669104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:16.669104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:32:16.670223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:32:16.670223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:32:16.670223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:32:16.670223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 445/904] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:32:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:32:16.675784 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c080ab8-58cc-4df4-9885-673549933ee5 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:16.776055 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c080ab8-58cc-4df4-9885-673549933ee5 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:16.810747 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9eb003-b14e-4433-a456-79b77ffcf945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:16.811627 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eb003-b14e-4433-a456-79b77ffcf945 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:16.818833 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eb003-b14e-4433-a456-79b77ffcf945 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:16.818833 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eb003-b14e-4433-a456-79b77ffcf945 None admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:16.818833 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9eb003-b14e-4433-a456-79b77ffcf945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:16.818833 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9eb003-b14e-4433-a456-79b77ffcf945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:16.818833 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9eb003-b14e-4433-a456-79b77ffcf945 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:16.826652 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 460/905] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 20:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:32:16.832571 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be3d71-0686-4dfa-a3e1-2f1634cdbf97 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:16.944363 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be3d71-0686-4dfa-a3e1-2f1634cdbf97 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:16.959630 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:16.979281 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695e6e8-a255-46f5-8f2c-07593d713466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:16.979941 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695e6e8-a255-46f5-8f2c-07593d713466 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:16.980220 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695e6e8-a255-46f5-8f2c-07593d713466 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:16.980491 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695e6e8-a255-46f5-8f2c-07593d713466 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:16.987312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695e6e8-a255-46f5-8f2c-07593d713466 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:16.988846 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695e6e8-a255-46f5-8f2c-07593d713466 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:17.000089 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application [None req-c695e6e8-a255-46f5-8f2c-07593d713466 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:32:17.000089 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:17.000089 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:17.000089 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:17.000089 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:17.000089 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:17.000089 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:17.000089 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:17.000089 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:17.000089 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:17.000089 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:17.000089 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:17.000089 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:32:17.000089 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:32:17.000089 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:32:17.012982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:32:17.012982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:17.012982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:17.012982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:17.012982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:17.012982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:17.012982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:17.012982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:17.012982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:17.012982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:17.012982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:17.012982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:17.012982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:17.012982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:17.012982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:17.012982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:17.012982 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:17.013889 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:32:17.013889 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:32:17.013889 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:32:17.013889 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:32:17.013889 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:32:17.013889 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:32:17.013889 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:32:17.013889 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: ERROR keystone.server.flask.application Aug 22 20:32:17.013889 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 446/906] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 20:32:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:32:17.014503 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9eb003-b14e-4433-a456-79b77ffcf945 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:17.058100 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:17.111640 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9eb003-b14e-4433-a456-79b77ffcf945 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:17.146837 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d6916-86fe-4bf1-bd0f-4ddd6c28786f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:17.147449 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d6916-86fe-4bf1-bd0f-4ddd6c28786f None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:17.147786 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d6916-86fe-4bf1-bd0f-4ddd6c28786f None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:17.148066 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d6916-86fe-4bf1-bd0f-4ddd6c28786f None admin] PATH_INFO: `/v3/projects` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:17.148784 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d6916-86fe-4bf1-bd0f-4ddd6c28786f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:17.149094 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d6916-86fe-4bf1-bd0f-4ddd6c28786f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:17.150543 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d6916-86fe-4bf1-bd0f-4ddd6c28786f None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:17.163088 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 461/907] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 20:32:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:17.169540 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695e6e8-a255-46f5-8f2c-07593d713466 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:17.274324 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695e6e8-a255-46f5-8f2c-07593d713466 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:17.307826 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73412d-75b9-4475-a37a-affa73618ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:17.308469 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73412d-75b9-4475-a37a-affa73618ca6 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:17.308784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73412d-75b9-4475-a37a-affa73618ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:17.309006 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73412d-75b9-4475-a37a-affa73618ca6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:17.309731 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73412d-75b9-4475-a37a-affa73618ca6 None admin] RBAC: Adding query filter params (role.id=1e3ce9c8b9934a7bb515b39e21fc1d68, scope.project.id=7bda5c44ace24608b8ca69e9059d73ef, user.id=e4117090fe4047f9b6a2b5eab5ff218c) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:17.310031 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73412d-75b9-4475-a37a-affa73618ca6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:17.311744 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73412d-75b9-4475-a37a-affa73618ca6 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:17.318668 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 447/908] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 20:32:17 2022] GET /identity/v3/role_assignments?user.id=e4117090fe4047f9b6a2b5eab5ff218c&scope.project.id=7bda5c44ace24608b8ca69e9059d73ef&role.id=1e3ce9c8b9934a7bb515b39e21fc1d68 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:19.591309 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf2656-478d-458a-94ab-17d9f1496292 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:19.591899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf2656-478d-458a-94ab-17d9f1496292 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:19.591899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf2656-478d-458a-94ab-17d9f1496292 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:19.593241 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 462/909] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:32:19.599256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c03597-63d4-4be2-b171-66e53695f5bf None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:19.599662 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c03597-63d4-4be2-b171-66e53695f5bf None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:19.604156 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c03597-63d4-4be2-b171-66e53695f5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:19.618094 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-b6c03597-63d4-4be2-b171-66e53695f5bf None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:32:19.619298 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-b6c03597-63d4-4be2-b171-66e53695f5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:32:19.649579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:19.686846 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 448/910] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:32:19 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:32:20.027852 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf2656-478d-458a-94ab-17d9f1496292 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:20.132136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf2656-478d-458a-94ab-17d9f1496292 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:20.139916 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:20.167645 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b7544-2bb1-4a3c-bb7c-6840eebcafa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:20.168275 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b7544-2bb1-4a3c-bb7c-6840eebcafa4 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:20.168555 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b7544-2bb1-4a3c-bb7c-6840eebcafa4 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:20.168830 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b7544-2bb1-4a3c-bb7c-6840eebcafa4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:20.169409 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b7544-2bb1-4a3c-bb7c-6840eebcafa4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:20.170776 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b7544-2bb1-4a3c-bb7c-6840eebcafa4 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:20.179284 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-551b7544-2bb1-4a3c-bb7c-6840eebcafa4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:32:20.179284 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:20.179284 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:32:20.179284 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:32:20.179284 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:32:20.179284 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:32:20.179284 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:32:20.179284 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:32:20.179284 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:32:20.179284 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:32:20.179284 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:32:20.179284 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:32:20.179284 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:20.179284 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:20.179284 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:20.179284 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:20.179284 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:20.184552 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:20.184552 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:20.184552 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:20.184552 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:20.184552 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:20.184552 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:20.184552 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:32:20.184552 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:32:20.184552 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:32:20.184552 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:32:20.184552 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:20.184552 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:20.184552 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:20.184552 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:20.184552 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:20.184552 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:20.186028 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:20.186028 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:20.186028 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:20.186028 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:20.186028 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:20.186028 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:20.186028 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:20.186028 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:20.186028 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:20.186028 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:20.186028 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:32:20.186028 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:32:20.186028 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:32:20.186028 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:32:20.186028 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 463/911] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Aug 22 20:32:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:32:20.187180 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c03597-63d4-4be2-b171-66e53695f5bf None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:20.288803 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c03597-63d4-4be2-b171-66e53695f5bf None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:20.324188 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3227d-9a55-4178-b0ff-169e25285ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:20.324786 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3227d-9a55-4178-b0ff-169e25285ac4 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:20.325061 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3227d-9a55-4178-b0ff-169e25285ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:20.325329 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3227d-9a55-4178-b0ff-169e25285ac4 None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:20.325945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3227d-9a55-4178-b0ff-169e25285ac4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:20.326239 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3227d-9a55-4178-b0ff-169e25285ac4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:20.327664 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3227d-9a55-4178-b0ff-169e25285ac4 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:20.333034 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 449/912] 10.222.0.15 () {56 vars in 1116 bytes} [Mon Aug 22 20:32:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:20.339011 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b7544-2bb1-4a3c-bb7c-6840eebcafa4 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:20.442026 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b7544-2bb1-4a3c-bb7c-6840eebcafa4 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:20.474996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30813a-c39e-40bd-87e1-78f439cbdaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:20.475615 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30813a-c39e-40bd-87e1-78f439cbdaf0 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:20.475895 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30813a-c39e-40bd-87e1-78f439cbdaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:20.476166 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30813a-c39e-40bd-87e1-78f439cbdaf0 None admin] PATH_INFO: `/v3/services` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:20.476789 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30813a-c39e-40bd-87e1-78f439cbdaf0 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:20.477089 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30813a-c39e-40bd-87e1-78f439cbdaf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:20.478447 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30813a-c39e-40bd-87e1-78f439cbdaf0 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:20.482880 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 464/913] 10.222.0.15 () {56 vars in 1116 bytes} [Mon Aug 22 20:32:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:22.675293 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a57632-13f1-4bcf-b082-8671a738ffe0 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:22.675852 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a57632-13f1-4bcf-b082-8671a738ffe0 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:22.675852 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a57632-13f1-4bcf-b082-8671a738ffe0 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:22.677223 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 450/914] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:32:22.682523 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdc0d9-c232-452a-b9be-7c60dce4cedb None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:22.682910 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdc0d9-c232-452a-b9be-7c60dce4cedb None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:22.683081 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdc0d9-c232-452a-b9be-7c60dce4cedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:22.701212 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-08fdc0d9-c232-452a-b9be-7c60dce4cedb None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:32:22.702387 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-08fdc0d9-c232-452a-b9be-7c60dce4cedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:32:22.729556 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:22.768791 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 465/915] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:32:22 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:32:23.099366 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a57632-13f1-4bcf-b082-8671a738ffe0 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:23.131203 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:23.200451 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a57632-13f1-4bcf-b082-8671a738ffe0 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:23.234384 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d41ee3-4c46-4614-9989-477ae4275758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:23.234975 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d41ee3-4c46-4614-9989-477ae4275758 None admin] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:23.235249 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d41ee3-4c46-4614-9989-477ae4275758 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:23.235518 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d41ee3-4c46-4614-9989-477ae4275758 None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:23.236177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d41ee3-4c46-4614-9989-477ae4275758 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:23.237637 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d41ee3-4c46-4614-9989-477ae4275758 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:23.356341 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 451/916] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 20:32:23 2022] POST /identity/v3/services => generated 246 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:32:25.541450 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83301654-c535-4a0e-9b0c-b24ff63264fe None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:25.541953 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83301654-c535-4a0e-9b0c-b24ff63264fe None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:25.542059 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83301654-c535-4a0e-9b0c-b24ff63264fe None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:25.543356 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 466/917] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:32:25.549491 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37d464-4ff5-404c-a1bd-f5c321a0154f None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:25.551085 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37d464-4ff5-404c-a1bd-f5c321a0154f None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:25.551085 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37d464-4ff5-404c-a1bd-f5c321a0154f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:25.568767 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-1f37d464-4ff5-404c-a1bd-f5c321a0154f None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:32:25.570027 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-1f37d464-4ff5-404c-a1bd-f5c321a0154f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:32:25.642440 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 452/918] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:32:25 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:32:25.976357 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83301654-c535-4a0e-9b0c-b24ff63264fe None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:26.078602 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83301654-c535-4a0e-9b0c-b24ff63264fe None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:26.112484 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066cb7a-6c7a-4214-8f80-139b9e7ee05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:26.113107 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066cb7a-6c7a-4214-8f80-139b9e7ee05f None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:26.113385 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066cb7a-6c7a-4214-8f80-139b9e7ee05f None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:26.113657 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066cb7a-6c7a-4214-8f80-139b9e7ee05f None admin] PATH_INFO: `/v3/services/placement` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:26.114239 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066cb7a-6c7a-4214-8f80-139b9e7ee05f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:26.115618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066cb7a-6c7a-4214-8f80-139b9e7ee05f None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:26.124403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-2066cb7a-6c7a-4214-8f80-139b9e7ee05f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:32:26.124403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:26.124403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:32:26.124403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:32:26.124403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:32:26.124403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:32:26.124403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:32:26.124403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:32:26.124403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:32:26.124403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:32:26.124403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:32:26.124403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:32:26.124403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:26.124403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:26.124403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:26.124403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:26.124403 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:26.125613 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:26.125613 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:26.125613 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:26.125613 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:26.125613 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:26.125613 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:26.125613 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:32:26.125613 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:32:26.125613 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:32:26.125613 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:32:26.125613 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:26.125613 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:26.125613 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:26.125613 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:26.125613 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:26.125613 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:26.126665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:26.126665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:26.126665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:26.126665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:26.126665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:26.126665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:26.126665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:26.126665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:26.126665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:26.126665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:26.126665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:32:26.126665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:32:26.126665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:32:26.126665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:32:26.126665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 467/919] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Aug 22 20:32:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:32:26.132259 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37d464-4ff5-404c-a1bd-f5c321a0154f None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:26.150932 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:26.230217 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37d464-4ff5-404c-a1bd-f5c321a0154f None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:26.263955 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c0e16-f07a-4c1b-b527-b014b070b6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:26.264550 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c0e16-f07a-4c1b-b527-b014b070b6c4 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:26.264825 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c0e16-f07a-4c1b-b527-b014b070b6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:26.265091 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c0e16-f07a-4c1b-b527-b014b070b6c4 None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:26.265703 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c0e16-f07a-4c1b-b527-b014b070b6c4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:26.265999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c0e16-f07a-4c1b-b527-b014b070b6c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:26.267697 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c0e16-f07a-4c1b-b527-b014b070b6c4 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:26.291949 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 453/920] 10.222.0.15 () {56 vars in 1116 bytes} [Mon Aug 22 20:32:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:26.292076 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066cb7a-6c7a-4214-8f80-139b9e7ee05f None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:26.307933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:26.379330 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066cb7a-6c7a-4214-8f80-139b9e7ee05f None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:26.412114 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c3339-06ba-475d-bb10-98c0a7ecea02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:26.412712 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c3339-06ba-475d-bb10-98c0a7ecea02 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:26.412992 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c3339-06ba-475d-bb10-98c0a7ecea02 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:26.413265 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c3339-06ba-475d-bb10-98c0a7ecea02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:26.413963 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c3339-06ba-475d-bb10-98c0a7ecea02 None admin] RBAC: Adding query filter params (interface=public, service_id=30c8bca54439451cb781c801048a9d61, region_id=RegionOne) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:26.414274 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c3339-06ba-475d-bb10-98c0a7ecea02 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:26.415727 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c3339-06ba-475d-bb10-98c0a7ecea02 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:26.420894 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 468/921] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Aug 22 20:32:26 2022] GET /identity/v3/endpoints?service_id=30c8bca54439451cb781c801048a9d61&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:26.427522 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c0e16-f07a-4c1b-b527-b014b070b6c4 None admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:26.509484 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:26.529539 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c0e16-f07a-4c1b-b527-b014b070b6c4 None admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:26.562911 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b80866-d49c-4592-8eff-537b0963bf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:26.563510 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b80866-d49c-4592-8eff-537b0963bf56 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:26.563821 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b80866-d49c-4592-8eff-537b0963bf56 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:26.564098 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b80866-d49c-4592-8eff-537b0963bf56 None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:26.565343 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b80866-d49c-4592-8eff-537b0963bf56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:26.566713 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b80866-d49c-4592-8eff-537b0963bf56 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:26.573053 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 454/922] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Aug 22 20:32:26 2022] GET /identity/v3/services => generated 1962 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:32:28.758483 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61506f6-3e94-4fde-a201-07eda63ef4a0 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:28.759018 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61506f6-3e94-4fde-a201-07eda63ef4a0 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:28.759018 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61506f6-3e94-4fde-a201-07eda63ef4a0 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:28.760369 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 469/923] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:32:28.765704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2066ddb-331c-4dc6-8250-aaceb653412e None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:28.766088 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2066ddb-331c-4dc6-8250-aaceb653412e None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:28.766271 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2066ddb-331c-4dc6-8250-aaceb653412e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:28.785522 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-d2066ddb-331c-4dc6-8250-aaceb653412e None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:32:28.786658 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-d2066ddb-331c-4dc6-8250-aaceb653412e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:32:28.853297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 455/924] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:32:28 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:32:29.179951 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61506f6-3e94-4fde-a201-07eda63ef4a0 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:29.276242 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:29.285978 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61506f6-3e94-4fde-a201-07eda63ef4a0 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:29.320311 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc77966-e796-4584-b032-b04ada0092f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:29.320954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc77966-e796-4584-b032-b04ada0092f0 None admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:29.321257 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc77966-e796-4584-b032-b04ada0092f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:29.321532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc77966-e796-4584-b032-b04ada0092f0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:29.322121 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc77966-e796-4584-b032-b04ada0092f0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:29.323487 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc77966-e796-4584-b032-b04ada0092f0 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:29.332730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application [None req-ddc77966-e796-4584-b032-b04ada0092f0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:32:29.332730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:29.332730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:32:29.332730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:32:29.332730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:32:29.332730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:32:29.332730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:32:29.332730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:32:29.332730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:32:29.332730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:32:29.332730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:32:29.332730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:32:29.332730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:32:29.332730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:32:29.332730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:32:29.332730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:32:29.332730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:32:29.333911 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:32:29.333911 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:32:29.333911 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:32:29.333911 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:32:29.333911 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:32:29.333911 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:32:29.333911 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:32:29.333911 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:32:29.333911 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:32:29.333911 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:32:29.333911 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:32:29.333911 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:32:29.333911 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:32:29.333911 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:32:29.333911 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:32:29.333911 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:32:29.334865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:32:29.334865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application with Lock( Aug 22 20:32:29.334865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:32:29.334865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:32:29.334865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:32:29.334865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:32:29.334865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:32:29.334865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:32:29.334865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:32:29.334865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:32:29.334865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:32:29.334865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:32:29.334865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:32:29.334865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: ERROR keystone.server.flask.application Aug 22 20:32:29.334865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 470/925] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Aug 22 20:32:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:32:29.340015 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2066ddb-331c-4dc6-8250-aaceb653412e None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:29.416084 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:29.439089 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2066ddb-331c-4dc6-8250-aaceb653412e None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:29.472734 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3eab2-429c-47ee-8353-29da9eecd2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:29.473327 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3eab2-429c-47ee-8353-29da9eecd2c5 None admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:29.473607 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3eab2-429c-47ee-8353-29da9eecd2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:29.473878 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3eab2-429c-47ee-8353-29da9eecd2c5 None admin] PATH_INFO: `/v3/services` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:29.474495 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3eab2-429c-47ee-8353-29da9eecd2c5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:32:29.474793 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3eab2-429c-47ee-8353-29da9eecd2c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:29.476195 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3eab2-429c-47ee-8353-29da9eecd2c5 None admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:29.481057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 456/926] 10.222.0.15 () {56 vars in 1116 bytes} [Mon Aug 22 20:32:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:32:29.487611 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc77966-e796-4584-b032-b04ada0092f0 None admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:32:29.588612 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc77966-e796-4584-b032-b04ada0092f0 None admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:32:29.621711 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0951cd-6525-4f0b-b22d-fb0b5e964307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:32:29.622310 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0951cd-6525-4f0b-b22d-fb0b5e964307 None admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:32:29.622593 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0951cd-6525-4f0b-b22d-fb0b5e964307 None admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:32:29.622868 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0951cd-6525-4f0b-b22d-fb0b5e964307 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:32:29.623516 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0951cd-6525-4f0b-b22d-fb0b5e964307 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:32:29.624915 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0951cd-6525-4f0b-b22d-fb0b5e964307 None admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:32:29.835323 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 471/927] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 20:32:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:32:39.497421 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=30 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:32:39.829025 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:25.679328 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d46114-717c-4a2c-aac6-6d13d97c1315 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:25.680026 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d46114-717c-4a2c-aac6-6d13d97c1315 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:25.680026 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d46114-717c-4a2c-aac6-6d13d97c1315 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:25.684005 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 457/928] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:41:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:41:25.690651 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985b7cc-d031-4561-98fa-e50d139bce62 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:25.691159 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985b7cc-d031-4561-98fa-e50d139bce62 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:25.691159 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985b7cc-d031-4561-98fa-e50d139bce62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:25.794236 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-4985b7cc-d031-4561-98fa-e50d139bce62 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:41:25.795656 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-4985b7cc-d031-4561-98fa-e50d139bce62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:25.973919 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 472/929] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:41:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:41:26.338413 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f793244-e3e0-43b9-83c2-bff9dd3b5e21 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:26.338692 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f793244-e3e0-43b9-83c2-bff9dd3b5e21 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:26.339127 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f793244-e3e0-43b9-83c2-bff9dd3b5e21 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:26.341114 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 458/930] 10.222.0.15 () {54 vars in 965 bytes} [Mon Aug 22 20:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:41:26.348831 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b0591-8192-4f46-b1a7-2293d144d932 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:26.349105 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b0591-8192-4f46-b1a7-2293d144d932 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:26.349456 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b0591-8192-4f46-b1a7-2293d144d932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:26.440126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-155b0591-8192-4f46-b1a7-2293d144d932 None None] MFA Rules not processed for user `340a791917d14686bb14e13544c1ce9b`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:41:26.441351 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-155b0591-8192-4f46-b1a7-2293d144d932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:26.475387 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:26.533480 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 473/931] 10.222.0.15 () {58 vars in 1062 bytes} [Mon Aug 22 20:41:26 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:41:26.543840 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f793244-e3e0-43b9-83c2-bff9dd3b5e21 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:26.555608 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f793244-e3e0-43b9-83c2-bff9dd3b5e21 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:26.559977 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748449e6-fac1-4b8b-bf59-475edacd87a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:26.563769 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748449e6-fac1-4b8b-bf59-475edacd87a7 service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:26.563769 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748449e6-fac1-4b8b-bf59-475edacd87a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:26.563769 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748449e6-fac1-4b8b-bf59-475edacd87a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:26.571242 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748449e6-fac1-4b8b-bf59-475edacd87a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:26.572798 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748449e6-fac1-4b8b-bf59-475edacd87a7 service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:26.583489 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 459/932] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:41:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:41:29.084671 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3233d9-a896-4b97-b237-293a3e9367c7 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:29.085169 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3233d9-a896-4b97-b237-293a3e9367c7 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:29.085169 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3233d9-a896-4b97-b237-293a3e9367c7 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:29.086490 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 474/933] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:41:29.092767 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e970b16-8c0d-44a3-ab3a-4bb0d9868645 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:29.093287 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e970b16-8c0d-44a3-ab3a-4bb0d9868645 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:29.093287 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e970b16-8c0d-44a3-ab3a-4bb0d9868645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:29.113343 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-0e970b16-8c0d-44a3-ab3a-4bb0d9868645 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:41:29.114587 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-0e970b16-8c0d-44a3-ab3a-4bb0d9868645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:29.123190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 460/934] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:41:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:41:29.461176 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3233d9-a896-4b97-b237-293a3e9367c7 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:29.471816 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3233d9-a896-4b97-b237-293a3e9367c7 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:29.475336 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ffe27-e6f1-45b2-a6a3-88194ebf1e3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:29.476054 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ffe27-e6f1-45b2-a6a3-88194ebf1e3c service neutron] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:29.476400 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ffe27-e6f1-45b2-a6a3-88194ebf1e3c service neutron] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:29.476743 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ffe27-e6f1-45b2-a6a3-88194ebf1e3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:29.486064 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ffe27-e6f1-45b2-a6a3-88194ebf1e3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:29.487679 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ffe27-e6f1-45b2-a6a3-88194ebf1e3c service neutron] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:29.497921 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 475/935] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:41:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:41:32.254181 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9f38e-6ef4-4ff2-9aa4-3bdbab5e6bcb None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:32.254715 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9f38e-6ef4-4ff2-9aa4-3bdbab5e6bcb None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:32.254715 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9f38e-6ef4-4ff2-9aa4-3bdbab5e6bcb None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:32.256146 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 461/936] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:41:32.262077 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b11389-0ac5-4e01-ac07-e52ee9d12e9d None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:32.262575 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b11389-0ac5-4e01-ac07-e52ee9d12e9d None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:32.262674 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b11389-0ac5-4e01-ac07-e52ee9d12e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:32.347878 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-b3b11389-0ac5-4e01-ac07-e52ee9d12e9d None None] MFA Rules not processed for user `2bcfb45b3fc3478a81cf1941e9ba32a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:41:32.349199 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-b3b11389-0ac5-4e01-ac07-e52ee9d12e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:32.448722 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 476/937] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:41:32 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:41:32.791048 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9f38e-6ef4-4ff2-9aa4-3bdbab5e6bcb None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:32.802174 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9f38e-6ef4-4ff2-9aa4-3bdbab5e6bcb None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:32.806305 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21acb166-cc6d-407e-868a-4bbb533f6002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:32.807034 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acb166-cc6d-407e-868a-4bbb533f6002 service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:32.807375 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acb166-cc6d-407e-868a-4bbb533f6002 service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:32.807749 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acb166-cc6d-407e-868a-4bbb533f6002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:32.817401 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21acb166-cc6d-407e-868a-4bbb533f6002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:32.818846 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21acb166-cc6d-407e-868a-4bbb533f6002 service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:32.829174 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 462/938] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:41:32 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:41:35.888285 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274c315-d1ef-490f-823a-a423dd67b7d8 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:35.888817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274c315-d1ef-490f-823a-a423dd67b7d8 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:35.888908 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274c315-d1ef-490f-823a-a423dd67b7d8 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:35.890336 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 477/939] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:41:35.895816 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9e0ad-cd82-4045-804c-e27801050746 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:35.896210 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9e0ad-cd82-4045-804c-e27801050746 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:35.896368 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9e0ad-cd82-4045-804c-e27801050746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:35.915416 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-35b9e0ad-cd82-4045-804c-e27801050746 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:41:35.917062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-35b9e0ad-cd82-4045-804c-e27801050746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:35.984884 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 463/940] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:41:35 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:41:36.354134 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb4244-ac57-4114-b69a-bf642b8576fc None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:36.354418 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb4244-ac57-4114-b69a-bf642b8576fc None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:36.354699 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb4244-ac57-4114-b69a-bf642b8576fc None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:36.356106 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 478/941] 10.222.0.15 () {54 vars in 965 bytes} [Mon Aug 22 20:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:41:36.362400 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebdf37-66af-42aa-943f-b683a4926e4d None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:36.362690 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebdf37-66af-42aa-943f-b683a4926e4d None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:36.362969 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebdf37-66af-42aa-943f-b683a4926e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:36.382608 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-faebdf37-66af-42aa-943f-b683a4926e4d None None] MFA Rules not processed for user `340a791917d14686bb14e13544c1ce9b`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:41:36.383857 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-faebdf37-66af-42aa-943f-b683a4926e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:36.390820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 464/942] 10.222.0.15 () {58 vars in 1062 bytes} [Mon Aug 22 20:41:36 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:41:36.399847 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb4244-ac57-4114-b69a-bf642b8576fc None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:36.410519 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb4244-ac57-4114-b69a-bf642b8576fc None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:36.414296 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557725c3-5720-4dc6-8f9e-cbf6213ebaf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:36.414911 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557725c3-5720-4dc6-8f9e-cbf6213ebaf5 service neutron] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:36.415215 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557725c3-5720-4dc6-8f9e-cbf6213ebaf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:36.415489 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557725c3-5720-4dc6-8f9e-cbf6213ebaf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:36.425163 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557725c3-5720-4dc6-8f9e-cbf6213ebaf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:36.426619 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557725c3-5720-4dc6-8f9e-cbf6213ebaf5 service neutron] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:36.436594 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 479/943] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:41:36 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:41:40.238070 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca0e4c-a181-4791-b53e-a1c2c6ecf7b2 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:40.238704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca0e4c-a181-4791-b53e-a1c2c6ecf7b2 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:40.238704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca0e4c-a181-4791-b53e-a1c2c6ecf7b2 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:40.240089 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 465/944] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:41:40.247128 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da0048-6f28-444c-8cf6-a3d6f023ce82 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:40.247721 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da0048-6f28-444c-8cf6-a3d6f023ce82 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:40.247721 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da0048-6f28-444c-8cf6-a3d6f023ce82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:40.271049 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-53da0048-6f28-444c-8cf6-a3d6f023ce82 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:41:40.272693 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-53da0048-6f28-444c-8cf6-a3d6f023ce82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:40.281263 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 480/945] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:41:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:41:40.628033 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca0e4c-a181-4791-b53e-a1c2c6ecf7b2 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:40.640441 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca0e4c-a181-4791-b53e-a1c2c6ecf7b2 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:40.644206 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8d102-db3d-4f8a-83eb-8f8a89b5dffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:40.644822 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8d102-db3d-4f8a-83eb-8f8a89b5dffd service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:40.645110 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8d102-db3d-4f8a-83eb-8f8a89b5dffd service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:40.645399 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8d102-db3d-4f8a-83eb-8f8a89b5dffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:40.658772 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8d102-db3d-4f8a-83eb-8f8a89b5dffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:40.660287 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8d102-db3d-4f8a-83eb-8f8a89b5dffd service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:40.671990 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 466/946] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:41:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:41:42.980693 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61535f-aa9a-47a2-8ed4-bb6f214085ac None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:42.981222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61535f-aa9a-47a2-8ed4-bb6f214085ac None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:42.981222 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61535f-aa9a-47a2-8ed4-bb6f214085ac None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:42.982509 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 481/947] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:41:42.988270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e434df-6d9b-447c-b75e-e54a63fe1190 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:42.988999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e434df-6d9b-447c-b75e-e54a63fe1190 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:42.989179 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e434df-6d9b-447c-b75e-e54a63fe1190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:43.008474 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-74e434df-6d9b-447c-b75e-e54a63fe1190 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:41:43.009682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-74e434df-6d9b-447c-b75e-e54a63fe1190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:43.017569 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 467/948] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:41:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:41:43.364866 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61535f-aa9a-47a2-8ed4-bb6f214085ac None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:43.375849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61535f-aa9a-47a2-8ed4-bb6f214085ac None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:43.379423 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388226e-ee27-4c2e-a6cb-3d8fb3ee33cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:43.380088 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388226e-ee27-4c2e-a6cb-3d8fb3ee33cb service neutron] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:43.380372 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388226e-ee27-4c2e-a6cb-3d8fb3ee33cb service neutron] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:43.380647 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388226e-ee27-4c2e-a6cb-3d8fb3ee33cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:43.390657 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388226e-ee27-4c2e-a6cb-3d8fb3ee33cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:43.392152 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388226e-ee27-4c2e-a6cb-3d8fb3ee33cb service neutron] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:43.403978 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 482/949] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:41:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:41:45.754104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a1d9b-8cd7-4df3-bafb-62cd5cad7207 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:45.754659 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a1d9b-8cd7-4df3-bafb-62cd5cad7207 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:45.754759 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a1d9b-8cd7-4df3-bafb-62cd5cad7207 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:45.756137 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 468/950] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:41:45.761768 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce495cd-fe4c-4b9b-9fdc-3a301e723cae None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:45.762292 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce495cd-fe4c-4b9b-9fdc-3a301e723cae None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:45.762466 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce495cd-fe4c-4b9b-9fdc-3a301e723cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:45.783195 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-3ce495cd-fe4c-4b9b-9fdc-3a301e723cae None None] MFA Rules not processed for user `2bcfb45b3fc3478a81cf1941e9ba32a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:41:45.784358 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-3ce495cd-fe4c-4b9b-9fdc-3a301e723cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:45.793595 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 483/951] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:41:45 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:41:46.137735 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a1d9b-8cd7-4df3-bafb-62cd5cad7207 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:46.148841 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a1d9b-8cd7-4df3-bafb-62cd5cad7207 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:46.152968 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3386da-55a0-46e4-ba5d-43ce6a49c457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:46.153567 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3386da-55a0-46e4-ba5d-43ce6a49c457 service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:46.153838 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3386da-55a0-46e4-ba5d-43ce6a49c457 service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:46.154109 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3386da-55a0-46e4-ba5d-43ce6a49c457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:46.164489 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3386da-55a0-46e4-ba5d-43ce6a49c457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:46.166588 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3386da-55a0-46e4-ba5d-43ce6a49c457 service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:46.176895 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 469/952] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:41:46 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:41:49.127971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35d95f-de0e-4970-91f8-4e55af603903 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:49.128506 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35d95f-de0e-4970-91f8-4e55af603903 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:49.128506 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35d95f-de0e-4970-91f8-4e55af603903 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:49.129849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 484/953] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:41:49.136426 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ada5d8-5184-4638-921a-ebcca2ed7d3a None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:49.137217 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ada5d8-5184-4638-921a-ebcca2ed7d3a None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:49.137386 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ada5d8-5184-4638-921a-ebcca2ed7d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:49.159034 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-49ada5d8-5184-4638-921a-ebcca2ed7d3a None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:41:49.159344 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-49ada5d8-5184-4638-921a-ebcca2ed7d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:49.169404 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 470/954] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:41:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:41:49.516270 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35d95f-de0e-4970-91f8-4e55af603903 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:49.528099 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35d95f-de0e-4970-91f8-4e55af603903 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:49.532844 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e29173-7fec-45b3-b228-9334ae7d9ca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:49.533564 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e29173-7fec-45b3-b228-9334ae7d9ca4 service neutron] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:49.533564 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e29173-7fec-45b3-b228-9334ae7d9ca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:49.533564 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e29173-7fec-45b3-b228-9334ae7d9ca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:49.545117 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e29173-7fec-45b3-b228-9334ae7d9ca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:49.546584 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e29173-7fec-45b3-b228-9334ae7d9ca4 service neutron] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:49.551254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:49.558886 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 485/955] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:41:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:41:51.862204 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d2c35-fec6-44ef-990c-5d7bf3ab1b7b None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:51.862745 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d2c35-fec6-44ef-990c-5d7bf3ab1b7b None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:51.862745 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d2c35-fec6-44ef-990c-5d7bf3ab1b7b None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:51.864270 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 471/956] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:41:51.870667 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35deed71-1d56-469b-af8e-088b1e00004a None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:51.871142 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35deed71-1d56-469b-af8e-088b1e00004a None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:51.871218 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35deed71-1d56-469b-af8e-088b1e00004a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:51.892017 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-35deed71-1d56-469b-af8e-088b1e00004a None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:41:51.893231 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-35deed71-1d56-469b-af8e-088b1e00004a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:51.901161 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 486/957] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:41:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:41:52.245129 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d2c35-fec6-44ef-990c-5d7bf3ab1b7b None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:52.250868 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=68 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:52.258291 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d2c35-fec6-44ef-990c-5d7bf3ab1b7b None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:52.265349 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dc1e7-8773-4711-9d16-cd84b1ac55e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:52.265349 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dc1e7-8773-4711-9d16-cd84b1ac55e7 service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:52.265349 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dc1e7-8773-4711-9d16-cd84b1ac55e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:52.265349 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dc1e7-8773-4711-9d16-cd84b1ac55e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:52.274302 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dc1e7-8773-4711-9d16-cd84b1ac55e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:52.276193 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dc1e7-8773-4711-9d16-cd84b1ac55e7 service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:52.290525 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 472/958] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:41:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:41:55.130304 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb7ce2-2652-4b03-94c3-e0dd683508e3 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:55.130898 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb7ce2-2652-4b03-94c3-e0dd683508e3 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:55.131101 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb7ce2-2652-4b03-94c3-e0dd683508e3 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:55.132425 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 487/959] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:41:55.138896 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6f9d8-3b34-487e-8f82-1f2891263de5 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:55.139424 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6f9d8-3b34-487e-8f82-1f2891263de5 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:55.139572 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6f9d8-3b34-487e-8f82-1f2891263de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:55.159306 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-2da6f9d8-3b34-487e-8f82-1f2891263de5 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:41:55.160946 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-2da6f9d8-3b34-487e-8f82-1f2891263de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:55.169172 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 473/960] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:41:55 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:41:55.512783 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb7ce2-2652-4b03-94c3-e0dd683508e3 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:55.524894 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb7ce2-2652-4b03-94c3-e0dd683508e3 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:55.528770 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2542f1-dd3b-412c-9b56-b853b44c5c80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:55.529412 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2542f1-dd3b-412c-9b56-b853b44c5c80 service neutron] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:55.529687 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2542f1-dd3b-412c-9b56-b853b44c5c80 service neutron] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:55.529959 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2542f1-dd3b-412c-9b56-b853b44c5c80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:55.541737 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2542f1-dd3b-412c-9b56-b853b44c5c80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:55.543280 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2542f1-dd3b-412c-9b56-b853b44c5c80 service neutron] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:55.554101 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 488/961] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:41:55 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:42:00.793506 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e5d5c-f229-40eb-ac1a-4ef96d45579e None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:00.794022 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e5d5c-f229-40eb-ac1a-4ef96d45579e None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:00.794022 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e5d5c-f229-40eb-ac1a-4ef96d45579e None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:00.795385 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 474/962] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:00.801145 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab00bc-f271-4a07-ac26-578544702e85 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:00.801636 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab00bc-f271-4a07-ac26-578544702e85 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:00.801724 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab00bc-f271-4a07-ac26-578544702e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:00.821730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-a8ab00bc-f271-4a07-ac26-578544702e85 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:00.822935 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-a8ab00bc-f271-4a07-ac26-578544702e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:00.835768 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 489/963] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:42:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:42:01.182956 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e5d5c-f229-40eb-ac1a-4ef96d45579e None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:01.195415 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e5d5c-f229-40eb-ac1a-4ef96d45579e None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:01.199355 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d12199-6014-40cc-a55c-288254e821e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:01.200027 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d12199-6014-40cc-a55c-288254e821e5 service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:01.200310 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d12199-6014-40cc-a55c-288254e821e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:01.200584 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d12199-6014-40cc-a55c-288254e821e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:01.212210 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d12199-6014-40cc-a55c-288254e821e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:01.213740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d12199-6014-40cc-a55c-288254e821e5 service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:01.225540 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 475/964] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:42:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:42:04.493008 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c56a5f-b01f-4d80-9a32-aeaef4953137 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:04.493563 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c56a5f-b01f-4d80-9a32-aeaef4953137 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:04.493563 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c56a5f-b01f-4d80-9a32-aeaef4953137 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:04.494786 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 490/965] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:42:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:04.500199 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544eaf06-adc5-4db8-9fbb-75d9b65caf4f None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:04.500634 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544eaf06-adc5-4db8-9fbb-75d9b65caf4f None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:04.500743 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544eaf06-adc5-4db8-9fbb-75d9b65caf4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:04.520386 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-544eaf06-adc5-4db8-9fbb-75d9b65caf4f None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:04.521618 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-544eaf06-adc5-4db8-9fbb-75d9b65caf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:04.530761 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 476/966] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:42:04 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:04.889447 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c56a5f-b01f-4d80-9a32-aeaef4953137 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:04.901498 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c56a5f-b01f-4d80-9a32-aeaef4953137 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:04.905321 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb634c-8712-4757-b847-3627823c9b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:04.905934 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb634c-8712-4757-b847-3627823c9b51 service neutron] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:04.906216 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb634c-8712-4757-b847-3627823c9b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:04.906490 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb634c-8712-4757-b847-3627823c9b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:04.917082 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb634c-8712-4757-b847-3627823c9b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:04.918578 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb634c-8712-4757-b847-3627823c9b51 service neutron] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:04.929290 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 491/967] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:42:04 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:42:10.237967 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eec01-221a-423a-aa03-440ac268dc66 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:10.238579 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eec01-221a-423a-aa03-440ac268dc66 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:10.238838 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eec01-221a-423a-aa03-440ac268dc66 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:10.241705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 477/968] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:42:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:10.249985 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a676d2-19b4-40ee-a4ae-8655ae7ddeab None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:10.250504 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a676d2-19b4-40ee-a4ae-8655ae7ddeab None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:10.250602 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a676d2-19b4-40ee-a4ae-8655ae7ddeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:10.274733 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-69a676d2-19b4-40ee-a4ae-8655ae7ddeab None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:10.276071 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-69a676d2-19b4-40ee-a4ae-8655ae7ddeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:10.285030 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 492/969] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:42:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:10.652512 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9eec01-221a-423a-aa03-440ac268dc66 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:10.665565 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9eec01-221a-423a-aa03-440ac268dc66 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:10.670865 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03704e-dfbb-480c-8962-0e3e29bd2312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:10.671467 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03704e-dfbb-480c-8962-0e3e29bd2312 service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:10.671774 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03704e-dfbb-480c-8962-0e3e29bd2312 service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:10.672088 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03704e-dfbb-480c-8962-0e3e29bd2312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:10.684506 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03704e-dfbb-480c-8962-0e3e29bd2312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:10.685972 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03704e-dfbb-480c-8962-0e3e29bd2312 service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:10.698486 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 478/970] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:42:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:42:16.738984 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b3745-a1e8-4166-86e2-a7410a0f226b None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:16.738984 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b3745-a1e8-4166-86e2-a7410a0f226b None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:16.738984 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b3745-a1e8-4166-86e2-a7410a0f226b None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:16.738984 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 493/971] 10.222.0.15 () {54 vars in 921 bytes} [Mon Aug 22 20:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:16.752589 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445a6cc-19e9-4330-9fa9-6731ad675043 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:16.752589 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445a6cc-19e9-4330-9fa9-6731ad675043 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:16.752589 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445a6cc-19e9-4330-9fa9-6731ad675043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:16.958805 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-0445a6cc-19e9-4330-9fa9-6731ad675043 None None] MFA Rules not processed for user `e4117090fe4047f9b6a2b5eab5ff218c`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:16.960844 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-0445a6cc-19e9-4330-9fa9-6731ad675043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:17.071104 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 479/972] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Aug 22 20:42:16 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:42:20.269178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=22 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:21.824966 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08722183-fa49-4841-a3e1-906e8e3e51ab None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:21.824966 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08722183-fa49-4841-a3e1-906e8e3e51ab None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:21.824966 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08722183-fa49-4841-a3e1-906e8e3e51ab None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:21.826536 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 494/973] 10.222.0.15 () {54 vars in 921 bytes} [Mon Aug 22 20:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:21.832538 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd674d-33da-4937-938b-197b7297bf63 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:21.833813 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd674d-33da-4937-938b-197b7297bf63 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:21.834425 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd674d-33da-4937-938b-197b7297bf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:21.870867 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-35bd674d-33da-4937-938b-197b7297bf63 None None] MFA Rules not processed for user `e4117090fe4047f9b6a2b5eab5ff218c`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:21.873237 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-35bd674d-33da-4937-938b-197b7297bf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:21.888879 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 480/974] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Aug 22 20:42:21 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:23.871366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b933b-86cc-44a9-8baa-cc5d86607b55 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:23.872823 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b933b-86cc-44a9-8baa-cc5d86607b55 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:23.873408 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b933b-86cc-44a9-8baa-cc5d86607b55 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:23.876790 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 495/975] 10.222.0.15 () {54 vars in 921 bytes} [Mon Aug 22 20:42:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:23.883165 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a141f30-9340-4f27-a670-e0c861b3d1c2 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:23.883760 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a141f30-9340-4f27-a670-e0c861b3d1c2 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:23.883856 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a141f30-9340-4f27-a670-e0c861b3d1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:23.896937 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=71 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:23.916539 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-3a141f30-9340-4f27-a670-e0c861b3d1c2 None None] MFA Rules not processed for user `e4117090fe4047f9b6a2b5eab5ff218c`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:23.918641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-3a141f30-9340-4f27-a670-e0c861b3d1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:23.927721 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 481/976] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Aug 22 20:42:23 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:28.197558 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01e276-122a-47ed-9144-ebd188b63c1c None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:28.198156 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01e276-122a-47ed-9144-ebd188b63c1c None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:28.198156 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01e276-122a-47ed-9144-ebd188b63c1c None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:28.199778 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 496/977] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:28.205971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568281b-e4bc-46f8-854c-0b4dcc5039cf None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:28.206495 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568281b-e4bc-46f8-854c-0b4dcc5039cf None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:28.206495 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568281b-e4bc-46f8-854c-0b4dcc5039cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:28.227457 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-7568281b-e4bc-46f8-854c-0b4dcc5039cf None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:28.228814 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-7568281b-e4bc-46f8-854c-0b4dcc5039cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:28.238065 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 482/978] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:42:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:28.707173 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ac730-7a0d-4232-ba46-844de483f36b None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:28.708582 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ac730-7a0d-4232-ba46-844de483f36b None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:28.709152 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ac730-7a0d-4232-ba46-844de483f36b None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:28.710933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 497/979] 10.222.0.15 () {54 vars in 962 bytes} [Mon Aug 22 20:42:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:28.719755 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508bef1-face-4c7d-8459-377f7523f10f None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:28.720301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508bef1-face-4c7d-8459-377f7523f10f None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:28.728578 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508bef1-face-4c7d-8459-377f7523f10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:28.780828 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-5508bef1-face-4c7d-8459-377f7523f10f None None] MFA Rules not processed for user `c18d1768fb7a4bac93b28d095b74caf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:28.782160 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-5508bef1-face-4c7d-8459-377f7523f10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:28.875229 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 483/980] 10.222.0.15 () {58 vars in 1059 bytes} [Mon Aug 22 20:42:28 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:28.884007 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ac730-7a0d-4232-ba46-844de483f36b None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:28.903963 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ac730-7a0d-4232-ba46-844de483f36b None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:28.909807 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d97a33-ef9f-4cfd-b8c8-eb9e19d08497 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:28.910531 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d97a33-ef9f-4cfd-b8c8-eb9e19d08497 service nova] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:28.910881 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d97a33-ef9f-4cfd-b8c8-eb9e19d08497 service nova] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:28.912054 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d97a33-ef9f-4cfd-b8c8-eb9e19d08497 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:28.920946 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d97a33-ef9f-4cfd-b8c8-eb9e19d08497 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:28.922787 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d97a33-ef9f-4cfd-b8c8-eb9e19d08497 service nova] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:28.934534 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 498/981] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:42:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:42:31.498923 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab3eda-6d4d-430b-8f41-eff51ec95fbb None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:31.499594 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab3eda-6d4d-430b-8f41-eff51ec95fbb None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:31.499594 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab3eda-6d4d-430b-8f41-eff51ec95fbb None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:31.501074 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 484/982] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:42:31.506409 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b4256-4a79-4c97-92d3-8794b5d65d40 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:31.506902 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b4256-4a79-4c97-92d3-8794b5d65d40 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:31.506995 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b4256-4a79-4c97-92d3-8794b5d65d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:31.526610 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-da5b4256-4a79-4c97-92d3-8794b5d65d40 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:31.528262 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-da5b4256-4a79-4c97-92d3-8794b5d65d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:31.540249 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 499/983] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:42:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:31.885533 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab3eda-6d4d-430b-8f41-eff51ec95fbb None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:31.900568 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab3eda-6d4d-430b-8f41-eff51ec95fbb None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:31.905758 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc46c25-8865-4f4e-8765-36575ad81f10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:31.906384 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc46c25-8865-4f4e-8765-36575ad81f10 service nova] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:31.906687 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc46c25-8865-4f4e-8765-36575ad81f10 service nova] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:31.907064 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc46c25-8865-4f4e-8765-36575ad81f10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:31.917402 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc46c25-8865-4f4e-8765-36575ad81f10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:31.919582 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc46c25-8865-4f4e-8765-36575ad81f10 service nova] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:31.935770 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 485/984] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:42:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:42:34.682738 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450411f-f2d3-4d58-bc5d-39620cc41f6d None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:34.683238 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450411f-f2d3-4d58-bc5d-39620cc41f6d None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:34.683238 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450411f-f2d3-4d58-bc5d-39620cc41f6d None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:34.684584 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 500/985] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:34.690221 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe619d-3dec-4515-aecb-6f46d61fb224 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:34.690730 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe619d-3dec-4515-aecb-6f46d61fb224 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:34.690972 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe619d-3dec-4515-aecb-6f46d61fb224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:34.712397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-36fe619d-3dec-4515-aecb-6f46d61fb224 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:34.713622 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-36fe619d-3dec-4515-aecb-6f46d61fb224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:34.721540 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 486/986] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:42:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:35.081904 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb88f49-53e7-4018-9af5-c56cd190109d None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:35.082271 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb88f49-53e7-4018-9af5-c56cd190109d None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:35.082755 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb88f49-53e7-4018-9af5-c56cd190109d None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:35.085524 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 501/987] 10.222.0.15 () {54 vars in 962 bytes} [Mon Aug 22 20:42:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:35.098328 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38a079-8ea5-4bd0-b82a-b282f5848da2 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:35.098328 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38a079-8ea5-4bd0-b82a-b282f5848da2 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:35.098328 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38a079-8ea5-4bd0-b82a-b282f5848da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:35.118015 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-cd38a079-8ea5-4bd0-b82a-b282f5848da2 None None] MFA Rules not processed for user `c18d1768fb7a4bac93b28d095b74caf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:35.119712 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-cd38a079-8ea5-4bd0-b82a-b282f5848da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:35.135784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 487/988] 10.222.0.15 () {58 vars in 1059 bytes} [Mon Aug 22 20:42:35 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:35.141716 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb88f49-53e7-4018-9af5-c56cd190109d None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:35.158460 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb88f49-53e7-4018-9af5-c56cd190109d None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:35.165731 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750af3f-415f-432d-a219-50bf053f717d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:35.166505 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750af3f-415f-432d-a219-50bf053f717d service nova] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:35.167334 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750af3f-415f-432d-a219-50bf053f717d service nova] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:35.167645 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750af3f-415f-432d-a219-50bf053f717d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:35.177513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750af3f-415f-432d-a219-50bf053f717d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:35.179366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750af3f-415f-432d-a219-50bf053f717d service nova] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:35.190716 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 502/989] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:42:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:42:37.769525 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4695c-be01-4261-a245-eb7c614aa0f0 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:37.770435 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4695c-be01-4261-a245-eb7c614aa0f0 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:37.770886 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4695c-be01-4261-a245-eb7c614aa0f0 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:37.777176 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 488/990] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:42:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:37.781618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90f5d7-4fc8-498b-a18d-cca0c4f425e5 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:37.782777 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90f5d7-4fc8-498b-a18d-cca0c4f425e5 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:37.783584 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90f5d7-4fc8-498b-a18d-cca0c4f425e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:37.836967 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-ba90f5d7-4fc8-498b-a18d-cca0c4f425e5 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:37.840054 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-ba90f5d7-4fc8-498b-a18d-cca0c4f425e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:37.856641 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 503/991] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:42:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:38.211209 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4695c-be01-4261-a245-eb7c614aa0f0 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:38.227024 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4695c-be01-4261-a245-eb7c614aa0f0 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:38.232473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a512207-7af5-417d-8bb9-c06429ffcafa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:38.233099 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a512207-7af5-417d-8bb9-c06429ffcafa service nova] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:38.233375 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a512207-7af5-417d-8bb9-c06429ffcafa service nova] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:38.233642 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a512207-7af5-417d-8bb9-c06429ffcafa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:38.244551 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a512207-7af5-417d-8bb9-c06429ffcafa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:38.259886 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a512207-7af5-417d-8bb9-c06429ffcafa service nova] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:38.280139 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 489/992] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:42:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:42:39.633016 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d565cfa-b195-41f7-93dc-d3bdd9dee1aa None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:39.634566 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d565cfa-b195-41f7-93dc-d3bdd9dee1aa None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:39.635273 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d565cfa-b195-41f7-93dc-d3bdd9dee1aa None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:39.646725 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c8ecd-0a19-4d4e-8df1-1ac0886e66d6 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:39.648157 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c8ecd-0a19-4d4e-8df1-1ac0886e66d6 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:39.648883 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c8ecd-0a19-4d4e-8df1-1ac0886e66d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:39.653778 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 504/993] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:42:39 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:39.682999 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-659c8ecd-0a19-4d4e-8df1-1ac0886e66d6 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:39.685460 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-659c8ecd-0a19-4d4e-8df1-1ac0886e66d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:39.704110 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 490/994] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:42:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:42:40.589446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cae77-facd-4b8b-a73b-598636306259 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:40.589446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cae77-facd-4b8b-a73b-598636306259 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:40.589446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cae77-facd-4b8b-a73b-598636306259 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:40.589446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 505/995] 10.222.0.15 () {54 vars in 964 bytes} [Mon Aug 22 20:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:40.597471 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165b67d-7995-494d-916b-a7b731900cc4 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:40.597471 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165b67d-7995-494d-916b-a7b731900cc4 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:40.597471 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165b67d-7995-494d-916b-a7b731900cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:40.655795 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-c165b67d-7995-494d-916b-a7b731900cc4 None None] MFA Rules not processed for user `d0b7833b75334bceb549f7184041aacc`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:40.657102 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-c165b67d-7995-494d-916b-a7b731900cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:40.709445 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:40.744274 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 491/996] 10.222.0.15 () {58 vars in 1061 bytes} [Mon Aug 22 20:42:40 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:40.749796 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cae77-facd-4b8b-a73b-598636306259 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:40.775015 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cae77-facd-4b8b-a73b-598636306259 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:40.781348 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2ccce-b129-4d19-bd94-ec8491e5d942 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0b7833b75334bceb549f7184041aacc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:40.782139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2ccce-b129-4d19-bd94-ec8491e5d942 service cinder] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:40.782526 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2ccce-b129-4d19-bd94-ec8491e5d942 service cinder] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:40.783174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2ccce-b129-4d19-bd94-ec8491e5d942 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:40.795966 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2ccce-b129-4d19-bd94-ec8491e5d942 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:40.797668 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2ccce-b129-4d19-bd94-ec8491e5d942 service cinder] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:40.810219 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 506/997] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:42:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:42:41.212156 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82383859-c17e-4264-8b8c-cd4bf889b900 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:41.212436 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82383859-c17e-4264-8b8c-cd4bf889b900 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:41.212930 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82383859-c17e-4264-8b8c-cd4bf889b900 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:41.214422 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 492/998] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:42:41.221773 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a4494-93bf-4dd1-9f2d-5a8a0b67605f None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:41.222060 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a4494-93bf-4dd1-9f2d-5a8a0b67605f None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:41.222366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a4494-93bf-4dd1-9f2d-5a8a0b67605f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:41.244120 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-be1a4494-93bf-4dd1-9f2d-5a8a0b67605f None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:41.245373 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-be1a4494-93bf-4dd1-9f2d-5a8a0b67605f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:41.254422 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 507/999] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:42:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:41.609082 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82383859-c17e-4264-8b8c-cd4bf889b900 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:41.625954 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82383859-c17e-4264-8b8c-cd4bf889b900 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:41.633279 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c65ab-972a-426e-a65f-b17a6834c74e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:41.634040 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c65ab-972a-426e-a65f-b17a6834c74e service nova] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:41.634468 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c65ab-972a-426e-a65f-b17a6834c74e service nova] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:41.634998 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c65ab-972a-426e-a65f-b17a6834c74e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:41.649912 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c65ab-972a-426e-a65f-b17a6834c74e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:41.652870 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c65ab-972a-426e-a65f-b17a6834c74e service nova] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:41.671643 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 493/1000] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:42:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:42:44.782970 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add462e-ff50-4390-a599-5479335b736d None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:44.783897 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add462e-ff50-4390-a599-5479335b736d None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:44.784360 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add462e-ff50-4390-a599-5479335b736d None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:44.786157 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 508/1001] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:42:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:44.793790 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27309a2f-3d46-48a0-9c68-4234316f4fb9 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:44.794301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27309a2f-3d46-48a0-9c68-4234316f4fb9 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:44.794699 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27309a2f-3d46-48a0-9c68-4234316f4fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:44.820543 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-27309a2f-3d46-48a0-9c68-4234316f4fb9 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:44.821765 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-27309a2f-3d46-48a0-9c68-4234316f4fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:44.831916 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 494/1002] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:42:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:45.245457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add462e-ff50-4390-a599-5479335b736d None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:45.270126 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add462e-ff50-4390-a599-5479335b736d None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:45.278734 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285f70e-19a1-46ae-9132-b54c669de01d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:45.279693 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285f70e-19a1-46ae-9132-b54c669de01d service nova] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:45.280271 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285f70e-19a1-46ae-9132-b54c669de01d service nova] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:45.280721 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285f70e-19a1-46ae-9132-b54c669de01d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:45.299239 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285f70e-19a1-46ae-9132-b54c669de01d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:45.301218 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285f70e-19a1-46ae-9132-b54c669de01d service nova] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:45.313329 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 509/1003] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:42:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:42:47.855706 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf346c2-97f4-4d6d-af88-371f2873e10e None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:47.856517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf346c2-97f4-4d6d-af88-371f2873e10e None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:47.856517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf346c2-97f4-4d6d-af88-371f2873e10e None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:47.857602 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 495/1004] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:47.864605 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93d7d9-b8aa-4a5c-aba6-1b8b0d1d4952 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:47.865142 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93d7d9-b8aa-4a5c-aba6-1b8b0d1d4952 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:47.865515 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93d7d9-b8aa-4a5c-aba6-1b8b0d1d4952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:47.890797 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-de93d7d9-b8aa-4a5c-aba6-1b8b0d1d4952 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:47.892202 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-de93d7d9-b8aa-4a5c-aba6-1b8b0d1d4952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:47.901224 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 510/1005] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:42:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:48.266715 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf346c2-97f4-4d6d-af88-371f2873e10e None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:48.285450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf346c2-97f4-4d6d-af88-371f2873e10e None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:48.291649 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbf79c-8d5e-478a-8e7d-63d007df1802 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:48.292443 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbf79c-8d5e-478a-8e7d-63d007df1802 service nova] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:48.292991 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbf79c-8d5e-478a-8e7d-63d007df1802 service nova] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:48.293395 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbf79c-8d5e-478a-8e7d-63d007df1802 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:48.305303 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bbf79c-8d5e-478a-8e7d-63d007df1802 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:48.307194 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bbf79c-8d5e-478a-8e7d-63d007df1802 service nova] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:48.319320 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 496/1006] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:42:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:42:50.731965 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bbe77-3208-4e3f-a858-cbbab651c560 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:50.732510 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bbe77-3208-4e3f-a858-cbbab651c560 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:50.732510 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bbe77-3208-4e3f-a858-cbbab651c560 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:50.733834 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 511/1007] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:50.741992 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0bc3e-46d7-4334-ab23-8430f6711da6 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:50.742863 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0bc3e-46d7-4334-ab23-8430f6711da6 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:50.743598 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0bc3e-46d7-4334-ab23-8430f6711da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:50.788268 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-11f0bc3e-46d7-4334-ab23-8430f6711da6 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:50.789522 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-11f0bc3e-46d7-4334-ab23-8430f6711da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:50.797732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 497/1008] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:42:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:51.146463 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bbe77-3208-4e3f-a858-cbbab651c560 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:51.162740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=37 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:51.173160 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bbe77-3208-4e3f-a858-cbbab651c560 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:51.181439 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8edc680-068c-417f-8499-e49f8760b2a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:51.183297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edc680-068c-417f-8499-e49f8760b2a7 service nova] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:51.183297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edc680-068c-417f-8499-e49f8760b2a7 service nova] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:51.183297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edc680-068c-417f-8499-e49f8760b2a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:51.193768 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8edc680-068c-417f-8499-e49f8760b2a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:51.196408 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8edc680-068c-417f-8499-e49f8760b2a7 service nova] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:51.211228 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 512/1009] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:42:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:42:54.945137 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fe078-ecae-4888-a90f-b37576d9bc05 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:54.945784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fe078-ecae-4888-a90f-b37576d9bc05 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:54.945784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fe078-ecae-4888-a90f-b37576d9bc05 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:54.947062 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 498/1010] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:54.953206 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1feec-0f7f-4711-8ee9-027f3c296d53 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:54.953783 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1feec-0f7f-4711-8ee9-027f3c296d53 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:54.953988 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1feec-0f7f-4711-8ee9-027f3c296d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:54.979895 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-ceb1feec-0f7f-4711-8ee9-027f3c296d53 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:54.981511 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-ceb1feec-0f7f-4711-8ee9-027f3c296d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:54.992139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 513/1011] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:42:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:55.439261 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fe078-ecae-4888-a90f-b37576d9bc05 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:55.454101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fe078-ecae-4888-a90f-b37576d9bc05 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:55.459498 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1ce3c-36b1-401d-b45f-0b8f8a454871 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:55.460157 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1ce3c-36b1-401d-b45f-0b8f8a454871 service nova] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:55.460449 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1ce3c-36b1-401d-b45f-0b8f8a454871 service nova] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:55.460735 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1ce3c-36b1-401d-b45f-0b8f8a454871 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:55.470776 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1ce3c-36b1-401d-b45f-0b8f8a454871 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:55.472514 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1ce3c-36b1-401d-b45f-0b8f8a454871 service nova] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:55.483262 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 499/1012] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:42:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:42:58.028629 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e267b-c51a-4f6c-9250-50b0a500c29a None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:58.029303 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e267b-c51a-4f6c-9250-50b0a500c29a None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:58.029303 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e267b-c51a-4f6c-9250-50b0a500c29a None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:58.030671 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 514/1013] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:58.036648 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247adcf-fd1b-4625-9893-59ca2fd93872 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:58.037158 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247adcf-fd1b-4625-9893-59ca2fd93872 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:58.037365 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247adcf-fd1b-4625-9893-59ca2fd93872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:58.057905 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-d247adcf-fd1b-4625-9893-59ca2fd93872 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:58.059135 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-d247adcf-fd1b-4625-9893-59ca2fd93872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:58.067825 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 500/1014] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:42:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:58.400163 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e975f80-83fb-49c0-8c0a-b48027716a15 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:58.400454 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e975f80-83fb-49c0-8c0a-b48027716a15 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:58.400732 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e975f80-83fb-49c0-8c0a-b48027716a15 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:58.402098 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 515/1015] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:58.409899 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa09ae3-cd7f-4c8b-8060-d09c03a4f63f None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:58.409899 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa09ae3-cd7f-4c8b-8060-d09c03a4f63f None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:58.409899 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa09ae3-cd7f-4c8b-8060-d09c03a4f63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:58.419268 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e975f80-83fb-49c0-8c0a-b48027716a15 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:58.429220 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-efa09ae3-cd7f-4c8b-8060-d09c03a4f63f None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:58.430451 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-efa09ae3-cd7f-4c8b-8060-d09c03a4f63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:58.434035 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e975f80-83fb-49c0-8c0a-b48027716a15 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:58.438659 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 501/1016] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:42:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:58.443840 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a0f7e-5e81-4aa8-a494-574a0c378068 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:58.443840 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a0f7e-5e81-4aa8-a494-574a0c378068 service nova] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:58.443840 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a0f7e-5e81-4aa8-a494-574a0c378068 service nova] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:58.443840 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a0f7e-5e81-4aa8-a494-574a0c378068 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:58.449150 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a0f7e-5e81-4aa8-a494-574a0c378068 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:58.450824 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a0f7e-5e81-4aa8-a494-574a0c378068 service nova] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:58.460793 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 516/1017] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:42:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:42:58.808022 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7989f-9d9e-4822-90cd-707a2782f046 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:58.839167 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7989f-9d9e-4822-90cd-707a2782f046 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:58.839167 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7989f-9d9e-4822-90cd-707a2782f046 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:58.839167 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 502/1018] 10.222.0.15 () {54 vars in 967 bytes} [Mon Aug 22 20:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:58.839676 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd895e0-3b05-40cf-b45a-e6bb78248088 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:58.839676 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd895e0-3b05-40cf-b45a-e6bb78248088 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:58.839676 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd895e0-3b05-40cf-b45a-e6bb78248088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:58.876927 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-8cd895e0-3b05-40cf-b45a-e6bb78248088 None None] MFA Rules not processed for user `dcac07ea52e44b7cb7df360dbec74254`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:58.878169 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-8cd895e0-3b05-40cf-b45a-e6bb78248088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:58.952428 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 517/1019] 10.222.0.15 () {58 vars in 1064 bytes} [Mon Aug 22 20:42:58 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:58.960741 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7989f-9d9e-4822-90cd-707a2782f046 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:58.972405 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7989f-9d9e-4822-90cd-707a2782f046 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:58.976308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cccd5-67af-499f-ba6a-35e61ce0c626 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcac07ea52e44b7cb7df360dbec74254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:58.976903 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cccd5-67af-499f-ba6a-35e61ce0c626 service glance] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:58.977178 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cccd5-67af-499f-ba6a-35e61ce0c626 service glance] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:58.977447 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cccd5-67af-499f-ba6a-35e61ce0c626 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:58.986987 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cccd5-67af-499f-ba6a-35e61ce0c626 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:58.988481 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cccd5-67af-499f-ba6a-35e61ce0c626 service glance] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:58.998690 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 503/1020] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:42:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:43:00.969180 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c7e00-3a2e-49bf-b4b6-c33c1207f885 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:01.037849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c7e00-3a2e-49bf-b4b6-c33c1207f885 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:01.037849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c7e00-3a2e-49bf-b4b6-c33c1207f885 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:01.037849 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 518/1021] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:43:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:01.038316 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aef2c-bfd8-4450-b6d7-a5775ba6d334 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:01.038316 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aef2c-bfd8-4450-b6d7-a5775ba6d334 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:01.038316 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aef2c-bfd8-4450-b6d7-a5775ba6d334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:01.038316 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-0f1aef2c-bfd8-4450-b6d7-a5775ba6d334 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:01.038316 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-0f1aef2c-bfd8-4450-b6d7-a5775ba6d334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:01.038316 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 504/1022] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:43:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:01.373752 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c7e00-3a2e-49bf-b4b6-c33c1207f885 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:01.388302 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c7e00-3a2e-49bf-b4b6-c33c1207f885 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:01.393507 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e73742-e216-442b-8828-acabae8ef461 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:01.394143 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e73742-e216-442b-8828-acabae8ef461 service nova] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:01.394421 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e73742-e216-442b-8828-acabae8ef461 service nova] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:01.394702 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e73742-e216-442b-8828-acabae8ef461 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:01.403996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e73742-e216-442b-8828-acabae8ef461 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:01.405627 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e73742-e216-442b-8828-acabae8ef461 service nova] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:01.417341 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 519/1023] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:03.973738 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2d3c7-965c-4207-90e1-86963eba8921 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:03.974503 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2d3c7-965c-4207-90e1-86963eba8921 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:03.974503 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2d3c7-965c-4207-90e1-86963eba8921 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:03.975623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 505/1024] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:03.981154 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d5ec7-68ca-42b4-bf57-2c3c26f46e9c None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:03.981757 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d5ec7-68ca-42b4-bf57-2c3c26f46e9c None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:03.981757 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d5ec7-68ca-42b4-bf57-2c3c26f46e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:04.004772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-665d5ec7-68ca-42b4-bf57-2c3c26f46e9c None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:04.006286 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-665d5ec7-68ca-42b4-bf57-2c3c26f46e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:04.013963 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 520/1025] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:43:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:43:04.374827 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2d3c7-965c-4207-90e1-86963eba8921 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:04.390678 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2d3c7-965c-4207-90e1-86963eba8921 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:04.398221 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf34b06-2227-4e42-a767-a5b82be2c8c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:04.398221 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf34b06-2227-4e42-a767-a5b82be2c8c7 service nova] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:04.398221 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf34b06-2227-4e42-a767-a5b82be2c8c7 service nova] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:04.398221 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf34b06-2227-4e42-a767-a5b82be2c8c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:04.408669 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf34b06-2227-4e42-a767-a5b82be2c8c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:04.410767 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf34b06-2227-4e42-a767-a5b82be2c8c7 service nova] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:04.429494 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 506/1026] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:13.997030 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=61 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:43:14.456173 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=53 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:43:15.220302 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d4ccb-4d3d-41d6-900a-0b7b3627c081 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:15.220925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d4ccb-4d3d-41d6-900a-0b7b3627c081 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:15.220925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d4ccb-4d3d-41d6-900a-0b7b3627c081 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:15.222350 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 521/1027] 10.222.0.15 () {54 vars in 918 bytes} [Mon Aug 22 20:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:15.227577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee9b8c-b5c6-4c44-987a-66757ced5755 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:15.227882 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee9b8c-b5c6-4c44-987a-66757ced5755 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:15.228163 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee9b8c-b5c6-4c44-987a-66757ced5755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:15.247873 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-ccee9b8c-b5c6-4c44-987a-66757ced5755 None None] MFA Rules not processed for user `e4117090fe4047f9b6a2b5eab5ff218c`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:15.250293 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-ccee9b8c-b5c6-4c44-987a-66757ced5755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:15.258865 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 507/1028] 10.222.0.15 () {58 vars in 1015 bytes} [Mon Aug 22 20:43:15 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:15.273329 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc85434-e859-4e9e-bfca-5f7562ec47ea None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:15.273612 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc85434-e859-4e9e-bfca-5f7562ec47ea None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:15.273887 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc85434-e859-4e9e-bfca-5f7562ec47ea None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:15.275217 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 522/1029] 10.222.0.15 () {54 vars in 918 bytes} [Mon Aug 22 20:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:15.280147 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe1690-87eb-4b7a-b131-5ef77c3919e1 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:15.280435 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe1690-87eb-4b7a-b131-5ef77c3919e1 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:15.280717 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe1690-87eb-4b7a-b131-5ef77c3919e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:15.300820 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-64fe1690-87eb-4b7a-b131-5ef77c3919e1 None None] MFA Rules not processed for user `c18d1768fb7a4bac93b28d095b74caf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:15.302029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-64fe1690-87eb-4b7a-b131-5ef77c3919e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:15.310568 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 508/1030] 10.222.0.15 () {58 vars in 1015 bytes} [Mon Aug 22 20:43:15 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:17.996289 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41473054-15d1-4bba-9dcf-46ee293b155a None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:17.996860 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41473054-15d1-4bba-9dcf-46ee293b155a None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:17.996860 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41473054-15d1-4bba-9dcf-46ee293b155a None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:17.998204 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 523/1031] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:18.004349 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940d342-97f1-42fa-b7fe-33d9418d3778 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:18.004955 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940d342-97f1-42fa-b7fe-33d9418d3778 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:18.004955 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940d342-97f1-42fa-b7fe-33d9418d3778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:18.024849 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-0940d342-97f1-42fa-b7fe-33d9418d3778 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:18.026098 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-0940d342-97f1-42fa-b7fe-33d9418d3778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:18.034802 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 509/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:43:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:43:18.383488 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41473054-15d1-4bba-9dcf-46ee293b155a None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:18.397264 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41473054-15d1-4bba-9dcf-46ee293b155a None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:18.402260 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8eb93-8b94-4e89-ab3a-5e15dc875fa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:18.402860 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8eb93-8b94-4e89-ab3a-5e15dc875fa8 service nova] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:18.403139 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8eb93-8b94-4e89-ab3a-5e15dc875fa8 service nova] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:18.403410 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8eb93-8b94-4e89-ab3a-5e15dc875fa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:18.412238 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8eb93-8b94-4e89-ab3a-5e15dc875fa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:18.413902 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8eb93-8b94-4e89-ab3a-5e15dc875fa8 service nova] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:18.424753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 524/1033] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:19.416367 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4ec40-d475-4fdc-95bf-eab172766d68 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:19.416939 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4ec40-d475-4fdc-95bf-eab172766d68 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:19.417064 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4ec40-d475-4fdc-95bf-eab172766d68 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:19.418358 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 510/1034] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:19.423494 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26f061-04ae-4f78-8c4e-2dd594fa4b33 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:19.423979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26f061-04ae-4f78-8c4e-2dd594fa4b33 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:19.424091 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26f061-04ae-4f78-8c4e-2dd594fa4b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:19.443858 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-ce26f061-04ae-4f78-8c4e-2dd594fa4b33 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:19.445076 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-ce26f061-04ae-4f78-8c4e-2dd594fa4b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:19.453453 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 525/1035] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:43:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:43:19.674431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4ec40-d475-4fdc-95bf-eab172766d68 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:19.688222 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4ec40-d475-4fdc-95bf-eab172766d68 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:19.693140 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692f0b5-2143-403c-b53d-226b5166f295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:19.693732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692f0b5-2143-403c-b53d-226b5166f295 service nova] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:19.694014 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692f0b5-2143-403c-b53d-226b5166f295 service nova] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:19.694287 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692f0b5-2143-403c-b53d-226b5166f295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:19.704127 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692f0b5-2143-403c-b53d-226b5166f295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:19.705797 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692f0b5-2143-403c-b53d-226b5166f295 service nova] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:19.715637 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 511/1036] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:20.623967 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b7904-f61c-4886-b810-4de1ec84f5dc None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:20.624560 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b7904-f61c-4886-b810-4de1ec84f5dc None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:20.624560 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b7904-f61c-4886-b810-4de1ec84f5dc None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:20.625848 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 526/1037] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:20.630910 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc21a26-5def-478d-9c40-70c62bb77e05 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:20.631330 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc21a26-5def-478d-9c40-70c62bb77e05 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:20.631465 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc21a26-5def-478d-9c40-70c62bb77e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:20.651228 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-2fc21a26-5def-478d-9c40-70c62bb77e05 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:20.652479 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-2fc21a26-5def-478d-9c40-70c62bb77e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:20.661268 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 512/1038] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:43:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:20.821188 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b7904-f61c-4886-b810-4de1ec84f5dc None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:20.835446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b7904-f61c-4886-b810-4de1ec84f5dc None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:20.840870 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef80397-c9f7-4ef4-9cf2-ed3e5e695bdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:20.841496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef80397-c9f7-4ef4-9cf2-ed3e5e695bdc service nova] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:20.841772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef80397-c9f7-4ef4-9cf2-ed3e5e695bdc service nova] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:20.842117 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef80397-c9f7-4ef4-9cf2-ed3e5e695bdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:20.851799 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef80397-c9f7-4ef4-9cf2-ed3e5e695bdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:20.853432 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef80397-c9f7-4ef4-9cf2-ed3e5e695bdc service nova] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:20.864674 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 527/1039] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:21.740962 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a965df-48a2-489c-9c4f-d0f590d4f8e0 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:21.741620 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a965df-48a2-489c-9c4f-d0f590d4f8e0 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:21.741620 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a965df-48a2-489c-9c4f-d0f590d4f8e0 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:21.742878 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 513/1040] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:21.747887 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598abf2-be86-4501-adf3-f4cb5ef0fe36 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:21.748298 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598abf2-be86-4501-adf3-f4cb5ef0fe36 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:21.748439 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598abf2-be86-4501-adf3-f4cb5ef0fe36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:21.768713 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-8598abf2-be86-4501-adf3-f4cb5ef0fe36 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:21.769931 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-8598abf2-be86-4501-adf3-f4cb5ef0fe36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:21.778367 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 528/1041] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:43:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:21.941412 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a965df-48a2-489c-9c4f-d0f590d4f8e0 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:21.955344 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a965df-48a2-489c-9c4f-d0f590d4f8e0 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:21.960265 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0fbd2-0983-4da2-aaa1-fe894b8ff33b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:21.960854 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0fbd2-0983-4da2-aaa1-fe894b8ff33b service nova] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:21.961135 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0fbd2-0983-4da2-aaa1-fe894b8ff33b service nova] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:21.961408 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0fbd2-0983-4da2-aaa1-fe894b8ff33b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:21.969395 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0fbd2-0983-4da2-aaa1-fe894b8ff33b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:21.970980 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0fbd2-0983-4da2-aaa1-fe894b8ff33b service nova] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:21.980479 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 514/1042] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:22.850077 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bb282-b4ba-44e4-871d-c031bb80859b None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:22.850694 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bb282-b4ba-44e4-871d-c031bb80859b None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:22.850694 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bb282-b4ba-44e4-871d-c031bb80859b None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:22.851979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 529/1043] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:22.857282 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28614fe-3029-4336-b1c2-401eb199c478 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:22.857800 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28614fe-3029-4336-b1c2-401eb199c478 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:22.858417 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28614fe-3029-4336-b1c2-401eb199c478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:22.881010 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-f28614fe-3029-4336-b1c2-401eb199c478 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:22.883013 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-f28614fe-3029-4336-b1c2-401eb199c478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:22.896323 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 515/1044] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:43:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:23.052298 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bb282-b4ba-44e4-871d-c031bb80859b None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:23.066064 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bb282-b4ba-44e4-871d-c031bb80859b None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:23.070980 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e70584-07b5-438a-9fa6-a79048d055b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:23.071630 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e70584-07b5-438a-9fa6-a79048d055b0 service nova] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:23.071916 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e70584-07b5-438a-9fa6-a79048d055b0 service nova] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:23.072187 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e70584-07b5-438a-9fa6-a79048d055b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:23.080385 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e70584-07b5-438a-9fa6-a79048d055b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:23.081971 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e70584-07b5-438a-9fa6-a79048d055b0 service nova] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:23.091366 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 530/1045] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:43:23.980044 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c8ce1-9226-462b-a041-d5ecb419ada6 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:23.980641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c8ce1-9226-462b-a041-d5ecb419ada6 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:23.980641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c8ce1-9226-462b-a041-d5ecb419ada6 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:23.982024 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 516/1046] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:23.988078 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e5010-0722-4017-b051-a92274ef2017 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:23.988608 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e5010-0722-4017-b051-a92274ef2017 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:23.988729 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e5010-0722-4017-b051-a92274ef2017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:24.009528 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-6d3e5010-0722-4017-b051-a92274ef2017 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:24.010832 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-6d3e5010-0722-4017-b051-a92274ef2017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:24.019306 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 531/1047] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:43:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:24.181825 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c8ce1-9226-462b-a041-d5ecb419ada6 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:24.196412 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c8ce1-9226-462b-a041-d5ecb419ada6 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:24.202217 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a41c5-8229-453b-98b2-63176b88aaf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:24.202840 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a41c5-8229-453b-98b2-63176b88aaf2 service nova] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:24.203121 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a41c5-8229-453b-98b2-63176b88aaf2 service nova] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:24.203395 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a41c5-8229-453b-98b2-63176b88aaf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:24.212533 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a41c5-8229-453b-98b2-63176b88aaf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:24.214148 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a41c5-8229-453b-98b2-63176b88aaf2 service nova] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:24.224754 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 517/1048] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:25.136378 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9ccea-6dfd-4504-b753-4409c8e023c0 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:25.138259 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9ccea-6dfd-4504-b753-4409c8e023c0 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:25.138259 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9ccea-6dfd-4504-b753-4409c8e023c0 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:25.138840 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 532/1049] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:25.144046 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf6f33-a30c-4887-b625-a8f94bfe97d5 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:25.144510 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf6f33-a30c-4887-b625-a8f94bfe97d5 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:25.144614 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf6f33-a30c-4887-b625-a8f94bfe97d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:25.163854 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-54bf6f33-a30c-4887-b625-a8f94bfe97d5 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:25.165057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-54bf6f33-a30c-4887-b625-a8f94bfe97d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:25.173482 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 518/1050] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:43:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:25.328939 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9ccea-6dfd-4504-b753-4409c8e023c0 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:25.342942 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9ccea-6dfd-4504-b753-4409c8e023c0 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:25.347948 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf1fe3-684a-4850-a6cd-dc42317dec4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:25.348585 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf1fe3-684a-4850-a6cd-dc42317dec4f service nova] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:25.348892 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf1fe3-684a-4850-a6cd-dc42317dec4f service nova] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:25.349168 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf1fe3-684a-4850-a6cd-dc42317dec4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:25.357397 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf1fe3-684a-4850-a6cd-dc42317dec4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:25.359673 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf1fe3-684a-4850-a6cd-dc42317dec4f service nova] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:25.369435 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 533/1051] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:26.250083 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1346e80-d9dd-42b2-94f9-196eaa61181f None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:26.250641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1346e80-d9dd-42b2-94f9-196eaa61181f None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:26.250641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1346e80-d9dd-42b2-94f9-196eaa61181f None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:26.252005 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 519/1052] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:26.257009 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159575d2-f464-4de6-8827-8c9f7473de4d None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:26.257418 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159575d2-f464-4de6-8827-8c9f7473de4d None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:26.257565 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159575d2-f464-4de6-8827-8c9f7473de4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:26.277105 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-159575d2-f464-4de6-8827-8c9f7473de4d None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:26.278232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-159575d2-f464-4de6-8827-8c9f7473de4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:26.286832 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 534/1053] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:43:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:26.443566 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1346e80-d9dd-42b2-94f9-196eaa61181f None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:26.458197 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1346e80-d9dd-42b2-94f9-196eaa61181f None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:26.470177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c88c9-12c6-41e0-b07e-175d6ee35012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:26.470847 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c88c9-12c6-41e0-b07e-175d6ee35012 service nova] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:26.471174 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c88c9-12c6-41e0-b07e-175d6ee35012 service nova] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:26.471495 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c88c9-12c6-41e0-b07e-175d6ee35012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:26.480760 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c88c9-12c6-41e0-b07e-175d6ee35012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:26.482474 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c88c9-12c6-41e0-b07e-175d6ee35012 service nova] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:26.492616 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 520/1054] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:27.382297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120bdeb-6612-40ea-b7e0-82130bf33459 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:27.382824 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120bdeb-6612-40ea-b7e0-82130bf33459 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:27.382824 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120bdeb-6612-40ea-b7e0-82130bf33459 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:27.384200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 535/1055] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:27.389285 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e104a7-bc72-4b5f-ac0f-025731ca4f8e None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:27.389715 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e104a7-bc72-4b5f-ac0f-025731ca4f8e None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:27.389893 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e104a7-bc72-4b5f-ac0f-025731ca4f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:27.410019 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-04e104a7-bc72-4b5f-ac0f-025731ca4f8e None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:27.411248 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-04e104a7-bc72-4b5f-ac0f-025731ca4f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:27.419202 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 521/1056] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:43:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:27.575159 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120bdeb-6612-40ea-b7e0-82130bf33459 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:27.588354 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120bdeb-6612-40ea-b7e0-82130bf33459 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:27.593703 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17daf575-d0be-449c-ae8e-311582dffa0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:27.594287 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daf575-d0be-449c-ae8e-311582dffa0f service nova] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:27.594562 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daf575-d0be-449c-ae8e-311582dffa0f service nova] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:27.594833 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daf575-d0be-449c-ae8e-311582dffa0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:27.602841 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17daf575-d0be-449c-ae8e-311582dffa0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:27.604439 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17daf575-d0be-449c-ae8e-311582dffa0f service nova] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:27.614081 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 536/1057] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:29.737033 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d08ca-6391-4c65-9c6d-57692fceba54 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:29.737567 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d08ca-6391-4c65-9c6d-57692fceba54 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:29.737567 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d08ca-6391-4c65-9c6d-57692fceba54 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:29.738957 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 522/1058] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:29.744961 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d83bc3-fa22-4448-b4b4-f54a5bb7121b None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:29.745455 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d83bc3-fa22-4448-b4b4-f54a5bb7121b None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:29.745545 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d83bc3-fa22-4448-b4b4-f54a5bb7121b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:29.767150 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-59d83bc3-fa22-4448-b4b4-f54a5bb7121b None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:29.768407 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-59d83bc3-fa22-4448-b4b4-f54a5bb7121b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:29.776610 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 537/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:43:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:30.124656 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d08ca-6391-4c65-9c6d-57692fceba54 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:30.135312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d08ca-6391-4c65-9c6d-57692fceba54 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:30.138812 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d2d99-f055-45d1-a94f-065d257b1f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:30.139426 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d2d99-f055-45d1-a94f-065d257b1f6f service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:30.139740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d2d99-f055-45d1-a94f-065d257b1f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:30.140011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d2d99-f055-45d1-a94f-065d257b1f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:30.149148 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d2d99-f055-45d1-a94f-065d257b1f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:30.150581 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d2d99-f055-45d1-a94f-065d257b1f6f service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:30.160971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 523/1060] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:32.604365 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f6db3-2cc1-4d96-9727-4f9dde9123cb None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:32.604984 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f6db3-2cc1-4d96-9727-4f9dde9123cb None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:32.604984 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f6db3-2cc1-4d96-9727-4f9dde9123cb None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:32.606271 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 538/1061] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:32.611975 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d0cbe-f8ac-4fb9-b274-384dadec60cc None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:32.612408 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d0cbe-f8ac-4fb9-b274-384dadec60cc None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:32.618165 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d0cbe-f8ac-4fb9-b274-384dadec60cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:32.631868 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-482d0cbe-f8ac-4fb9-b274-384dadec60cc None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:32.633068 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-482d0cbe-f8ac-4fb9-b274-384dadec60cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:32.641377 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 524/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:43:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:32.987507 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f6db3-2cc1-4d96-9727-4f9dde9123cb None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:32.998627 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f6db3-2cc1-4d96-9727-4f9dde9123cb None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:33.002305 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c2da8-9365-469b-811f-5e0d6a248f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:33.002923 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c2da8-9365-469b-811f-5e0d6a248f41 service neutron] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:33.003207 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c2da8-9365-469b-811f-5e0d6a248f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:33.003484 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c2da8-9365-469b-811f-5e0d6a248f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:33.013090 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c2da8-9365-469b-811f-5e0d6a248f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:33.014561 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c2da8-9365-469b-811f-5e0d6a248f41 service neutron] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:33.024200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 539/1063] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:35.603429 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d402a-e187-4fb2-8842-ae517083a05d None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:35.604017 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d402a-e187-4fb2-8842-ae517083a05d None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:35.604017 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d402a-e187-4fb2-8842-ae517083a05d None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:35.605379 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 525/1064] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:35.611318 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215e21b-83e0-4306-96fe-c0c97cf4eb1e None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:35.611871 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215e21b-83e0-4306-96fe-c0c97cf4eb1e None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:35.611966 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215e21b-83e0-4306-96fe-c0c97cf4eb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:35.631514 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-1215e21b-83e0-4306-96fe-c0c97cf4eb1e None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:35.632756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-1215e21b-83e0-4306-96fe-c0c97cf4eb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:35.640918 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 540/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:43:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:35.987236 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d402a-e187-4fb2-8842-ae517083a05d None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:35.998086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d402a-e187-4fb2-8842-ae517083a05d None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:36.001600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2f04f-057f-4b6d-b5b4-5db94e02a27b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:36.002186 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2f04f-057f-4b6d-b5b4-5db94e02a27b service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:36.002464 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2f04f-057f-4b6d-b5b4-5db94e02a27b service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:36.002733 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2f04f-057f-4b6d-b5b4-5db94e02a27b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:36.011684 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2f04f-057f-4b6d-b5b4-5db94e02a27b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:36.013115 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2f04f-057f-4b6d-b5b4-5db94e02a27b service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:36.022493 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 526/1066] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:38.372271 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079c847-3c18-48c9-a30d-a6d960389039 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:38.372808 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079c847-3c18-48c9-a30d-a6d960389039 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:38.372808 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079c847-3c18-48c9-a30d-a6d960389039 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:38.374167 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 541/1067] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:38.379522 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7802fcc-8343-41c4-9a22-e78ef044c666 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:38.379975 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7802fcc-8343-41c4-9a22-e78ef044c666 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:38.380100 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7802fcc-8343-41c4-9a22-e78ef044c666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:38.399231 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-b7802fcc-8343-41c4-9a22-e78ef044c666 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:38.400480 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-b7802fcc-8343-41c4-9a22-e78ef044c666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:38.409436 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 527/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:43:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:38.754864 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079c847-3c18-48c9-a30d-a6d960389039 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:38.766917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079c847-3c18-48c9-a30d-a6d960389039 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:38.770473 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ecd14-b532-4dc9-a72d-bef5679ab9a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:38.771072 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ecd14-b532-4dc9-a72d-bef5679ab9a5 service neutron] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:38.771348 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ecd14-b532-4dc9-a72d-bef5679ab9a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:38.771653 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ecd14-b532-4dc9-a72d-bef5679ab9a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:38.781622 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ecd14-b532-4dc9-a72d-bef5679ab9a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:38.783056 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ecd14-b532-4dc9-a72d-bef5679ab9a5 service neutron] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:38.792572 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 542/1069] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:41.074416 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45631539-b84d-4a6d-a2b4-7d05556a3cf4 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:41.074976 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45631539-b84d-4a6d-a2b4-7d05556a3cf4 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:41.074976 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45631539-b84d-4a6d-a2b4-7d05556a3cf4 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:41.076435 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 528/1070] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:41.082468 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fdd2c-0572-489e-b63c-10538958197c None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:41.082949 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fdd2c-0572-489e-b63c-10538958197c None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:41.083044 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fdd2c-0572-489e-b63c-10538958197c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:41.102817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-067fdd2c-0572-489e-b63c-10538958197c None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:41.104110 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-067fdd2c-0572-489e-b63c-10538958197c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:41.113627 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 543/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:43:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:41.455710 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45631539-b84d-4a6d-a2b4-7d05556a3cf4 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:41.467124 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45631539-b84d-4a6d-a2b4-7d05556a3cf4 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:41.470750 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a35d1-9819-498c-ab3b-5ace334cb30f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:41.471352 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a35d1-9819-498c-ab3b-5ace334cb30f service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:41.471663 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a35d1-9819-498c-ab3b-5ace334cb30f service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:41.471934 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a35d1-9819-498c-ab3b-5ace334cb30f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:41.480745 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a35d1-9819-498c-ab3b-5ace334cb30f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:41.482205 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a35d1-9819-498c-ab3b-5ace334cb30f service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:41.491423 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 529/1072] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:43.729263 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ee62d-b4f6-4315-b1ae-bf796ae177af None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:43.729775 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ee62d-b4f6-4315-b1ae-bf796ae177af None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:43.729775 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ee62d-b4f6-4315-b1ae-bf796ae177af None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:43.731805 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 544/1073] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:43:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:43.737190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9c8e1-1cef-480d-ac47-9c85d9b158f6 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:43.737627 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9c8e1-1cef-480d-ac47-9c85d9b158f6 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:43.737720 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9c8e1-1cef-480d-ac47-9c85d9b158f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:43.757273 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-a0b9c8e1-1cef-480d-ac47-9c85d9b158f6 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:43.758478 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-a0b9c8e1-1cef-480d-ac47-9c85d9b158f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:43.766377 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 530/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:43:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:44.103278 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ee62d-b4f6-4315-b1ae-bf796ae177af None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:44.109411 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=64 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:43:44.115331 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ee62d-b4f6-4315-b1ae-bf796ae177af None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:44.118861 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089b10b-29b9-433d-8bf2-86859af18d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:44.119454 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089b10b-29b9-433d-8bf2-86859af18d6c service neutron] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:44.119814 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089b10b-29b9-433d-8bf2-86859af18d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:44.120096 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089b10b-29b9-433d-8bf2-86859af18d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:44.129609 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089b10b-29b9-433d-8bf2-86859af18d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:44.131041 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089b10b-29b9-433d-8bf2-86859af18d6c service neutron] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:44.140508 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 545/1075] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:46.379680 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6549b7-d869-4ef0-8790-414e8680e28f None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:46.380302 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6549b7-d869-4ef0-8790-414e8680e28f None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:46.380302 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6549b7-d869-4ef0-8790-414e8680e28f None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:46.381605 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 531/1076] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:46.387319 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e6f47-f899-4cd8-bd87-b7f43b663e24 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:46.387926 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e6f47-f899-4cd8-bd87-b7f43b663e24 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:46.387926 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e6f47-f899-4cd8-bd87-b7f43b663e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:46.409691 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-6a3e6f47-f899-4cd8-bd87-b7f43b663e24 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:46.410920 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-6a3e6f47-f899-4cd8-bd87-b7f43b663e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:46.419392 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 546/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:43:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:46.758631 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6549b7-d869-4ef0-8790-414e8680e28f None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:46.764136 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=73 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:43:46.769974 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6549b7-d869-4ef0-8790-414e8680e28f None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:46.773653 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73975445-5cb1-43f2-b7c1-45a0e5daaafa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:46.777168 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73975445-5cb1-43f2-b7c1-45a0e5daaafa service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:46.777168 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73975445-5cb1-43f2-b7c1-45a0e5daaafa service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:46.777168 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73975445-5cb1-43f2-b7c1-45a0e5daaafa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:46.784433 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73975445-5cb1-43f2-b7c1-45a0e5daaafa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:46.785876 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73975445-5cb1-43f2-b7c1-45a0e5daaafa service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:46.795925 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 532/1078] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:49.048513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a3cee-ac4a-4818-bd81-a761d911be65 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:49.049087 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a3cee-ac4a-4818-bd81-a761d911be65 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:49.049087 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a3cee-ac4a-4818-bd81-a761d911be65 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:49.050409 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 547/1079] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:49.055986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd86ea6-26ff-4c79-a38b-5412e9f0782e None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:49.056420 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd86ea6-26ff-4c79-a38b-5412e9f0782e None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:49.056540 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd86ea6-26ff-4c79-a38b-5412e9f0782e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:49.076316 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-0dd86ea6-26ff-4c79-a38b-5412e9f0782e None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:49.077548 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-0dd86ea6-26ff-4c79-a38b-5412e9f0782e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:49.085544 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 533/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:43:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:49.426775 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a3cee-ac4a-4818-bd81-a761d911be65 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:49.437679 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a3cee-ac4a-4818-bd81-a761d911be65 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:49.441307 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfa945-3716-40b1-8a4f-edb438c6c0e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:49.441909 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfa945-3716-40b1-8a4f-edb438c6c0e7 service neutron] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:49.442190 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfa945-3716-40b1-8a4f-edb438c6c0e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:49.442460 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfa945-3716-40b1-8a4f-edb438c6c0e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:49.452044 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfa945-3716-40b1-8a4f-edb438c6c0e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:49.453495 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfa945-3716-40b1-8a4f-edb438c6c0e7 service neutron] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:49.463640 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 548/1081] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:43:51.688064 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a76b0-467c-4b3c-8a6a-7e78d0d17916 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:51.688611 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a76b0-467c-4b3c-8a6a-7e78d0d17916 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:51.688611 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a76b0-467c-4b3c-8a6a-7e78d0d17916 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:51.689958 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 534/1082] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:51.695563 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df7bcd-04e7-4832-868a-6169e1afcd3b None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:51.696071 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df7bcd-04e7-4832-868a-6169e1afcd3b None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:51.696173 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df7bcd-04e7-4832-868a-6169e1afcd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:51.716140 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-98df7bcd-04e7-4832-868a-6169e1afcd3b None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:51.717883 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-98df7bcd-04e7-4832-868a-6169e1afcd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:51.725723 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 549/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:43:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:52.063358 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a76b0-467c-4b3c-8a6a-7e78d0d17916 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:52.074589 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a76b0-467c-4b3c-8a6a-7e78d0d17916 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:52.078122 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02582afb-2d24-4cb3-bb46-34ec93c50f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:52.078716 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02582afb-2d24-4cb3-bb46-34ec93c50f71 service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:52.078997 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02582afb-2d24-4cb3-bb46-34ec93c50f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:52.079272 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02582afb-2d24-4cb3-bb46-34ec93c50f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:52.088185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02582afb-2d24-4cb3-bb46-34ec93c50f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:52.090224 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02582afb-2d24-4cb3-bb46-34ec93c50f71 service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:52.099734 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 535/1084] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:54.302253 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99dca6-a414-4d61-857e-a842839c64fc None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:54.302830 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99dca6-a414-4d61-857e-a842839c64fc None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:54.302830 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99dca6-a414-4d61-857e-a842839c64fc None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:54.304184 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 550/1085] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:54.309868 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caac2ff-6f3c-45b2-88d0-ddf467cafc7c None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:54.310357 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caac2ff-6f3c-45b2-88d0-ddf467cafc7c None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:54.310473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caac2ff-6f3c-45b2-88d0-ddf467cafc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:54.330287 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-8caac2ff-6f3c-45b2-88d0-ddf467cafc7c None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:54.331560 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-8caac2ff-6f3c-45b2-88d0-ddf467cafc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:54.340221 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 536/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:43:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:54.677212 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99dca6-a414-4d61-857e-a842839c64fc None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:54.688417 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99dca6-a414-4d61-857e-a842839c64fc None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:54.692042 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18afb80-c6f8-4f6c-b5b0-65f5bde96cc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:54.692640 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18afb80-c6f8-4f6c-b5b0-65f5bde96cc8 service neutron] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:54.692916 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18afb80-c6f8-4f6c-b5b0-65f5bde96cc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:54.693182 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18afb80-c6f8-4f6c-b5b0-65f5bde96cc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:54.702590 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18afb80-c6f8-4f6c-b5b0-65f5bde96cc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:54.704125 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18afb80-c6f8-4f6c-b5b0-65f5bde96cc8 service neutron] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:54.713304 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 551/1087] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:04.325474 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=17 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:44:04.709348 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=23 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:44:19.701413 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13563caf-2ed4-417b-ae88-f7840e9c78c1 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:19.702058 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13563caf-2ed4-417b-ae88-f7840e9c78c1 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:19.702058 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13563caf-2ed4-417b-ae88-f7840e9c78c1 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:19.703300 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 537/1088] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:19.708997 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17725b-9a3d-4482-a2e5-3c021eebd878 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:19.713620 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17725b-9a3d-4482-a2e5-3c021eebd878 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:19.713620 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17725b-9a3d-4482-a2e5-3c021eebd878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:19.730797 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-ff17725b-9a3d-4482-a2e5-3c021eebd878 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:19.731975 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-ff17725b-9a3d-4482-a2e5-3c021eebd878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:19.739839 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 552/1089] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:44:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:44:20.094796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72f578-dd4a-44eb-82a8-7b151ecda87f None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:20.095082 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72f578-dd4a-44eb-82a8-7b151ecda87f None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:20.095357 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72f578-dd4a-44eb-82a8-7b151ecda87f None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:20.096748 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 538/1090] 10.222.0.15 () {54 vars in 967 bytes} [Mon Aug 22 20:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:20.102537 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c1f4d-859a-4d77-8135-61a8dd94057f None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:20.102818 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c1f4d-859a-4d77-8135-61a8dd94057f None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:20.103090 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c1f4d-859a-4d77-8135-61a8dd94057f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:20.122736 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-5f8c1f4d-859a-4d77-8135-61a8dd94057f None None] MFA Rules not processed for user `dcac07ea52e44b7cb7df360dbec74254`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:20.123976 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-5f8c1f4d-859a-4d77-8135-61a8dd94057f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:20.130373 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 553/1091] 10.222.0.15 () {58 vars in 1064 bytes} [Mon Aug 22 20:44:20 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:20.138633 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72f578-dd4a-44eb-82a8-7b151ecda87f None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:20.150445 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72f578-dd4a-44eb-82a8-7b151ecda87f None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:20.154653 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3994fb-add8-480d-b0c1-f3d7a9b1693a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcac07ea52e44b7cb7df360dbec74254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:20.155351 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3994fb-add8-480d-b0c1-f3d7a9b1693a service glance] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:20.155673 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3994fb-add8-480d-b0c1-f3d7a9b1693a service glance] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:20.156001 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3994fb-add8-480d-b0c1-f3d7a9b1693a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:20.166102 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3994fb-add8-480d-b0c1-f3d7a9b1693a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:20.167730 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3994fb-add8-480d-b0c1-f3d7a9b1693a service glance] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:20.178997 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 539/1092] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:22.567155 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe831a-842b-4628-9f97-26c505d4827d None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:22.567733 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe831a-842b-4628-9f97-26c505d4827d None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:22.567733 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe831a-842b-4628-9f97-26c505d4827d None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:22.569117 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 554/1093] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:22.574581 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fcae0-6ea4-4acb-8e97-a903df1b573c None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:22.575042 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fcae0-6ea4-4acb-8e97-a903df1b573c None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:22.575147 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fcae0-6ea4-4acb-8e97-a903df1b573c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:22.596600 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-770fcae0-6ea4-4acb-8e97-a903df1b573c None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:22.597978 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-770fcae0-6ea4-4acb-8e97-a903df1b573c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:22.607601 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 540/1094] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:44:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:22.942777 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe831a-842b-4628-9f97-26c505d4827d None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:22.956837 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe831a-842b-4628-9f97-26c505d4827d None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:22.961819 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8e8d3-1890-4e02-bd31-91d645ff69f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:22.962317 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8e8d3-1890-4e02-bd31-91d645ff69f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:22.962600 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8e8d3-1890-4e02-bd31-91d645ff69f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:22.962875 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8e8d3-1890-4e02-bd31-91d645ff69f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:22.963635 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8e8d3-1890-4e02-bd31-91d645ff69f3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:22.965537 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: WARNING py.warnings [None req-e9a8e8d3-1890-4e02-bd31-91d645ff69f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:44:22.965537 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: warnings.warn(msg) Aug 22 20:44:22.965537 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: Aug 22 20:44:22.966694 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8e8d3-1890-4e02-bd31-91d645ff69f3 admin admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:22.987777 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 555/1095] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 20:44:22 2022] GET /identity/v3/projects => generated 1606 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:44:25.285487 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f64fab-6057-4da7-91b3-d9d70ee0af8b None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:25.286155 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f64fab-6057-4da7-91b3-d9d70ee0af8b None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:25.286155 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f64fab-6057-4da7-91b3-d9d70ee0af8b None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:25.287408 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 541/1096] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:25.294128 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520914c-6f7d-4b84-8d68-9bf15fd36028 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:25.294591 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520914c-6f7d-4b84-8d68-9bf15fd36028 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:25.294887 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520914c-6f7d-4b84-8d68-9bf15fd36028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:25.317121 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-f520914c-6f7d-4b84-8d68-9bf15fd36028 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:25.318544 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-f520914c-6f7d-4b84-8d68-9bf15fd36028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:25.327707 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 556/1097] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:44:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:25.681469 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f64fab-6057-4da7-91b3-d9d70ee0af8b None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:25.695237 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f64fab-6057-4da7-91b3-d9d70ee0af8b None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:25.701760 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee036c-0ccf-46d6-be8b-f54123b84d6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:25.702367 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee036c-0ccf-46d6-be8b-f54123b84d6e service nova] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:25.702644 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee036c-0ccf-46d6-be8b-f54123b84d6e service nova] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:25.702979 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee036c-0ccf-46d6-be8b-f54123b84d6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:25.712641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee036c-0ccf-46d6-be8b-f54123b84d6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:25.714265 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee036c-0ccf-46d6-be8b-f54123b84d6e service nova] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:25.725363 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 542/1098] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:28.260388 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fc5c1-616e-48ba-9ef7-22e522a798f4 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:28.260998 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fc5c1-616e-48ba-9ef7-22e522a798f4 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:28.261237 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fc5c1-616e-48ba-9ef7-22e522a798f4 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:28.263960 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 557/1099] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:44:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:28.271896 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa376428-a39d-450a-8a21-e3ef66cb3f55 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:28.272473 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa376428-a39d-450a-8a21-e3ef66cb3f55 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:28.272882 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa376428-a39d-450a-8a21-e3ef66cb3f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:28.293762 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-fa376428-a39d-450a-8a21-e3ef66cb3f55 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:28.295812 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-fa376428-a39d-450a-8a21-e3ef66cb3f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:28.303445 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 543/1100] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:44:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:28.662807 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fc5c1-616e-48ba-9ef7-22e522a798f4 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:28.674426 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fc5c1-616e-48ba-9ef7-22e522a798f4 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:28.678122 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be9600-f9a0-4af1-8838-23731cf12f45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:28.678741 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be9600-f9a0-4af1-8838-23731cf12f45 service neutron] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:28.679019 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be9600-f9a0-4af1-8838-23731cf12f45 service neutron] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:28.679291 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be9600-f9a0-4af1-8838-23731cf12f45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:28.690892 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be9600-f9a0-4af1-8838-23731cf12f45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:28.692383 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be9600-f9a0-4af1-8838-23731cf12f45 service neutron] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:28.703507 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 558/1101] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:30.956266 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f99f0-d0f2-4f2f-95c2-9cb93eb1c6c2 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:30.956810 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f99f0-d0f2-4f2f-95c2-9cb93eb1c6c2 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:30.956810 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f99f0-d0f2-4f2f-95c2-9cb93eb1c6c2 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:30.958136 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 544/1102] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:30.963600 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c63b2-4347-435e-a4f4-db61e0309670 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:30.964463 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c63b2-4347-435e-a4f4-db61e0309670 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:30.964463 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c63b2-4347-435e-a4f4-db61e0309670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:30.983591 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-913c63b2-4347-435e-a4f4-db61e0309670 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:30.984847 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-913c63b2-4347-435e-a4f4-db61e0309670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:30.992809 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 559/1103] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:44:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:31.337132 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f99f0-d0f2-4f2f-95c2-9cb93eb1c6c2 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:31.349011 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f99f0-d0f2-4f2f-95c2-9cb93eb1c6c2 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:31.352756 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec7d71-86a0-4b26-a619-bd325d3c994a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:31.353393 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec7d71-86a0-4b26-a619-bd325d3c994a service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:31.353679 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec7d71-86a0-4b26-a619-bd325d3c994a service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:31.354550 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec7d71-86a0-4b26-a619-bd325d3c994a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:31.364092 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec7d71-86a0-4b26-a619-bd325d3c994a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:31.365587 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec7d71-86a0-4b26-a619-bd325d3c994a service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:31.375621 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 545/1104] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:33.671311 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fd04e-a0cc-47bb-a2fd-912f88b7bcc8 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:33.672023 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fd04e-a0cc-47bb-a2fd-912f88b7bcc8 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:33.672023 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fd04e-a0cc-47bb-a2fd-912f88b7bcc8 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:33.673215 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 560/1105] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:33.678903 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab97fe9-7826-4c23-beba-7f3b09343090 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:33.679380 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab97fe9-7826-4c23-beba-7f3b09343090 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:33.679490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab97fe9-7826-4c23-beba-7f3b09343090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:33.699431 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-5ab97fe9-7826-4c23-beba-7f3b09343090 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:33.700673 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-5ab97fe9-7826-4c23-beba-7f3b09343090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:33.708713 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 546/1106] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:44:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:34.061129 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fd04e-a0cc-47bb-a2fd-912f88b7bcc8 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:34.072104 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fd04e-a0cc-47bb-a2fd-912f88b7bcc8 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:34.076144 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db71023-d2aa-404e-8f8e-ff89118d8c10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:34.076859 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db71023-d2aa-404e-8f8e-ff89118d8c10 service neutron] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:34.077160 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db71023-d2aa-404e-8f8e-ff89118d8c10 service neutron] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:34.077478 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db71023-d2aa-404e-8f8e-ff89118d8c10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:34.086966 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db71023-d2aa-404e-8f8e-ff89118d8c10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:34.088484 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db71023-d2aa-404e-8f8e-ff89118d8c10 service neutron] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:34.098702 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 561/1107] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:36.759788 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9193080-d775-4694-8b31-0b958fff9a32 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:36.760348 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9193080-d775-4694-8b31-0b958fff9a32 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:36.760348 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9193080-d775-4694-8b31-0b958fff9a32 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:36.761782 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 547/1108] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 20:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:36.767854 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f3c6f-4334-4579-9cd4-1c788f14e78a None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:36.768372 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f3c6f-4334-4579-9cd4-1c788f14e78a None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:36.768372 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f3c6f-4334-4579-9cd4-1c788f14e78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:36.787647 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-963f3c6f-4334-4579-9cd4-1c788f14e78a None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:36.788811 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-963f3c6f-4334-4579-9cd4-1c788f14e78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:36.796598 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 562/1109] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 20:44:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:37.140328 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9193080-d775-4694-8b31-0b958fff9a32 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:37.151250 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9193080-d775-4694-8b31-0b958fff9a32 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:37.155046 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9329d-722d-44d9-bbf6-4cab5396de95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:37.155727 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9329d-722d-44d9-bbf6-4cab5396de95 service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:37.155963 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9329d-722d-44d9-bbf6-4cab5396de95 service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:37.156533 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9329d-722d-44d9-bbf6-4cab5396de95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:37.165616 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9329d-722d-44d9-bbf6-4cab5396de95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:37.167054 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9329d-722d-44d9-bbf6-4cab5396de95 service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:37.177131 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 548/1110] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:46.782659 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=33 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:44:47.172903 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=33 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:46:06.520709 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d12495-30f1-41e2-ad18-ad49de340f88 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:06.521332 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d12495-30f1-41e2-ad18-ad49de340f88 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:06.521332 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d12495-30f1-41e2-ad18-ad49de340f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:06.541768 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-b9d12495-30f1-41e2-ad18-ad49de340f88 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:46:06.543017 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-b9d12495-30f1-41e2-ad18-ad49de340f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:46:06.551464 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 563/1111] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 20:46:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:46:06.560068 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a45f1f-3c39-43a1-ab4f-3236afc3b65b None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:06.560610 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a45f1f-3c39-43a1-ab4f-3236afc3b65b None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:06.560610 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a45f1f-3c39-43a1-ab4f-3236afc3b65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:06.581694 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-c3a45f1f-3c39-43a1-ab4f-3236afc3b65b None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:46:06.582923 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-c3a45f1f-3c39-43a1-ab4f-3236afc3b65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:46:06.591858 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 549/1112] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 20:46:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:46:06.596579 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d12495-30f1-41e2-ad18-ad49de340f88 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:46:06.606228 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d12495-30f1-41e2-ad18-ad49de340f88 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:46:06.611267 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d7b17-4bd0-4719-8b6e-19b9c2b440c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:46:06.611895 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d7b17-4bd0-4719-8b6e-19b9c2b440c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:06.612174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d7b17-4bd0-4719-8b6e-19b9c2b440c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:06.612445 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d7b17-4bd0-4719-8b6e-19b9c2b440c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:06.613114 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d7b17-4bd0-4719-8b6e-19b9c2b440c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:46:06.613412 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d7b17-4bd0-4719-8b6e-19b9c2b440c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:46:06.614419 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: WARNING py.warnings [None req-db3d7b17-4bd0-4719-8b6e-19b9c2b440c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:46:06.614419 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: warnings.warn(msg) Aug 22 20:46:06.614419 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: Aug 22 20:46:06.615300 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d7b17-4bd0-4719-8b6e-19b9c2b440c9 admin admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:46:06.626634 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 564/1113] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 20:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:46:06.635064 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a45f1f-3c39-43a1-ab4f-3236afc3b65b None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:46:06.644439 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a45f1f-3c39-43a1-ab4f-3236afc3b65b None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:46:06.649200 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca918026-da50-4652-b56e-b1a70231dbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:46:06.649829 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca918026-da50-4652-b56e-b1a70231dbed admin admin] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:06.650110 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca918026-da50-4652-b56e-b1a70231dbed admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:06.650385 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca918026-da50-4652-b56e-b1a70231dbed admin admin] PATH_INFO: `/v3/projects` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:06.651040 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca918026-da50-4652-b56e-b1a70231dbed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:46:06.652874 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: WARNING py.warnings [None req-ca918026-da50-4652-b56e-b1a70231dbed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:46:06.652874 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: warnings.warn(msg) Aug 22 20:46:06.652874 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: Aug 22 20:46:06.654663 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca918026-da50-4652-b56e-b1a70231dbed admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:46:06.816687 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 550/1114] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 20:46:06 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:46:06.817889 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d7b17-4bd0-4719-8b6e-19b9c2b440c9 admin admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:46:06.828134 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d7b17-4bd0-4719-8b6e-19b9c2b440c9 admin admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:46:06.883756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4a41c-6bda-43dc-99ad-af9b9eee6c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:46:06.884280 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4a41c-6bda-43dc-99ad-af9b9eee6c6a admin admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:06.884555 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4a41c-6bda-43dc-99ad-af9b9eee6c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:06.884825 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4a41c-6bda-43dc-99ad-af9b9eee6c6a admin admin] PATH_INFO: `/v3/users` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:06.885446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4a41c-6bda-43dc-99ad-af9b9eee6c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:46:06.886470 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: WARNING py.warnings [None req-17c4a41c-6bda-43dc-99ad-af9b9eee6c6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:46:06.886470 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: warnings.warn(msg) Aug 22 20:46:06.886470 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: Aug 22 20:46:06.887696 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4a41c-6bda-43dc-99ad-af9b9eee6c6a admin admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:46:07.028530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 565/1115] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 20:46:06 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:46:07.032790 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca918026-da50-4652-b56e-b1a70231dbed admin admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:46:07.043265 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca918026-da50-4652-b56e-b1a70231dbed admin admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:46:07.048414 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa64de-0ac8-49fc-958f-760345ff1e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:46:07.049115 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa64de-0ac8-49fc-958f-760345ff1e79 admin admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:07.049374 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa64de-0ac8-49fc-958f-760345ff1e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:07.049654 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa64de-0ac8-49fc-958f-760345ff1e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:07.050339 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa64de-0ac8-49fc-958f-760345ff1e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:46:07.051432 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: WARNING py.warnings [None req-a6aa64de-0ac8-49fc-958f-760345ff1e79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:46:07.051432 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: warnings.warn(msg) Aug 22 20:46:07.051432 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: Aug 22 20:46:07.052626 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa64de-0ac8-49fc-958f-760345ff1e79 admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:46:07.067413 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 551/1116] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 20:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:46:07.071596 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4a41c-6bda-43dc-99ad-af9b9eee6c6a admin admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:46:07.081490 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4a41c-6bda-43dc-99ad-af9b9eee6c6a admin admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:46:07.085884 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842a852-7c04-4374-a2f4-f5b56f2015e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:46:07.086486 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842a852-7c04-4374-a2f4-f5b56f2015e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:07.086755 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842a852-7c04-4374-a2f4-f5b56f2015e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:07.087022 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842a852-7c04-4374-a2f4-f5b56f2015e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:07.087693 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842a852-7c04-4374-a2f4-f5b56f2015e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:46:07.088692 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: WARNING py.warnings [None req-e842a852-7c04-4374-a2f4-f5b56f2015e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:46:07.088692 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: warnings.warn(msg) Aug 22 20:46:07.088692 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: Aug 22 20:46:07.089569 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842a852-7c04-4374-a2f4-f5b56f2015e0 admin admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:46:07.102785 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 566/1117] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 20:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:46:07.107704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa64de-0ac8-49fc-958f-760345ff1e79 admin admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:46:07.117980 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa64de-0ac8-49fc-958f-760345ff1e79 admin admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:46:07.123466 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eed39e-6949-4631-82bc-e206f3a31fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:46:07.124177 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eed39e-6949-4631-82bc-e206f3a31fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:07.124453 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eed39e-6949-4631-82bc-e206f3a31fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:07.124722 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eed39e-6949-4631-82bc-e206f3a31fe4 admin admin] PATH_INFO: `/v3/projects/ea9b5240e1c54fb8a19b7666b6a81aab/users/a8875cfd3868495ca1d8c889bdbd10df/roles/910e8004690649e3b4fc1c4be76ad967` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:07.139410 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eed39e-6949-4631-82bc-e206f3a31fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9b5240e1c54fb8a19b7666b6a81aab, user_id=a8875cfd3868495ca1d8c889bdbd10df, role_id=910e8004690649e3b4fc1c4be76ad967)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:46:07.140477 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: WARNING py.warnings [None req-49eed39e-6949-4631-82bc-e206f3a31fe4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:46:07.140477 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: warnings.warn(msg) Aug 22 20:46:07.140477 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: Aug 22 20:46:07.142415 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eed39e-6949-4631-82bc-e206f3a31fe4 admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:46:07.212118 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 552/1118] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 20:46:07 2022] PUT /identity/v3/projects/ea9b5240e1c54fb8a19b7666b6a81aab/users/a8875cfd3868495ca1d8c889bdbd10df/roles/910e8004690649e3b4fc1c4be76ad967 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:46:07.224533 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4fa83-4b33-4d8f-b2e9-ff4a18e43e49 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:07.224824 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4fa83-4b33-4d8f-b2e9-ff4a18e43e49 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:07.225124 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4fa83-4b33-4d8f-b2e9-ff4a18e43e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:07.253102 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-3da4fa83-4b33-4d8f-b2e9-ff4a18e43e49 None None] MFA Rules not processed for user `a8875cfd3868495ca1d8c889bdbd10df`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:46:07.254310 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-3da4fa83-4b33-4d8f-b2e9-ff4a18e43e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:46:07.318430 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 567/1119] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 20:46:07 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:46:07.331779 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cda22c-b2a6-49cc-b3ab-46b381b89c13 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:07.332069 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cda22c-b2a6-49cc-b3ab-46b381b89c13 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:07.332350 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cda22c-b2a6-49cc-b3ab-46b381b89c13 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:07.333676 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 553/1120] 10.222.0.15 () {54 vars in 964 bytes} [Mon Aug 22 20:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:46:07.338690 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce39a62-dec5-4fc8-b48c-0565d73093bb None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:07.338985 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce39a62-dec5-4fc8-b48c-0565d73093bb None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:07.339299 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce39a62-dec5-4fc8-b48c-0565d73093bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:07.360149 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-2ce39a62-dec5-4fc8-b48c-0565d73093bb None None] MFA Rules not processed for user `d0b7833b75334bceb549f7184041aacc`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:46:07.361401 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-2ce39a62-dec5-4fc8-b48c-0565d73093bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:46:07.407494 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:46:07.415317 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 568/1121] 10.222.0.15 () {58 vars in 1061 bytes} [Mon Aug 22 20:46:07 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:46:07.423880 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cda22c-b2a6-49cc-b3ab-46b381b89c13 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:46:07.435175 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cda22c-b2a6-49cc-b3ab-46b381b89c13 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:46:07.438733 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02646b8-748b-4fc8-96ed-afe7b875267f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0b7833b75334bceb549f7184041aacc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:46:07.440295 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02646b8-748b-4fc8-96ed-afe7b875267f service cinder] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:07.440295 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02646b8-748b-4fc8-96ed-afe7b875267f service cinder] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:07.440295 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02646b8-748b-4fc8-96ed-afe7b875267f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:07.448322 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02646b8-748b-4fc8-96ed-afe7b875267f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:46:07.449758 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02646b8-748b-4fc8-96ed-afe7b875267f service cinder] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:46:07.459190 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 554/1122] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:46:07 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:46:07.501275 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60b8c8-e8b9-4cf8-b971-6df160f5fb60 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:07.501563 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60b8c8-e8b9-4cf8-b971-6df160f5fb60 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:07.501840 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60b8c8-e8b9-4cf8-b971-6df160f5fb60 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:07.503101 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 569/1123] 10.222.0.15 () {52 vars in 830 bytes} [Mon Aug 22 20:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:46:07.506547 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02646b8-748b-4fc8-96ed-afe7b875267f service cinder] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:46:07.573137 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02646b8-748b-4fc8-96ed-afe7b875267f service cinder] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:46:07.578084 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76550cf0-8b16-4da6-ad6f-6f7089642dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:46:07.579814 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76550cf0-8b16-4da6-ad6f-6f7089642dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:07.579814 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76550cf0-8b16-4da6-ad6f-6f7089642dad admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:07.579814 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76550cf0-8b16-4da6-ad6f-6f7089642dad admin admin] PATH_INFO: `/v3/users/a8875cfd3868495ca1d8c889bdbd10df` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:07.580810 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76550cf0-8b16-4da6-ad6f-6f7089642dad admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8875cfd3868495ca1d8c889bdbd10df)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:46:07.581874 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: WARNING py.warnings [None req-76550cf0-8b16-4da6-ad6f-6f7089642dad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:46:07.581874 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: warnings.warn(msg) Aug 22 20:46:07.581874 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: Aug 22 20:46:07.583184 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76550cf0-8b16-4da6-ad6f-6f7089642dad admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:46:08.039064 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-76550cf0-8b16-4da6-ad6f-6f7089642dad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8875cfd3868495ca1d8c889bdbd10df'} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:46:08.039907 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-76550cf0-8b16-4da6-ad6f-6f7089642dad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8875cfd3868495ca1d8c889bdbd10df'} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:46:08.123311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-76550cf0-8b16-4da6-ad6f-6f7089642dad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8875cfd3868495ca1d8c889bdbd10df'} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:46:08.123953 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-76550cf0-8b16-4da6-ad6f-6f7089642dad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8875cfd3868495ca1d8c889bdbd10df'} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:46:08.138604 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-76550cf0-8b16-4da6-ad6f-6f7089642dad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8875cfd3868495ca1d8c889bdbd10df'} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:46:08.160165 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:46:08.168083 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 555/1124] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 20:46:07 2022] DELETE /identity/v3/users/a8875cfd3868495ca1d8c889bdbd10df => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:46:08.173285 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba044bab-acd4-423c-844c-98422d290607 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:08.173784 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba044bab-acd4-423c-844c-98422d290607 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:08.173892 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba044bab-acd4-423c-844c-98422d290607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:08.192453 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-ba044bab-acd4-423c-844c-98422d290607 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:46:08.193645 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-ba044bab-acd4-423c-844c-98422d290607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:46:08.257812 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 570/1125] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 20:46:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:46:08.267732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76550cf0-8b16-4da6-ad6f-6f7089642dad admin admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:46:08.269601 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-76550cf0-8b16-4da6-ad6f-6f7089642dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:46:08.327282 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76550cf0-8b16-4da6-ad6f-6f7089642dad admin admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:46:08.330823 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7d406-40bb-4d44-9a52-86959b5eb9c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:46:08.331423 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7d406-40bb-4d44-9a52-86959b5eb9c1 service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:08.331732 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7d406-40bb-4d44-9a52-86959b5eb9c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:08.332002 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7d406-40bb-4d44-9a52-86959b5eb9c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:08.340836 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7d406-40bb-4d44-9a52-86959b5eb9c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:46:08.342901 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7d406-40bb-4d44-9a52-86959b5eb9c1 service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:46:08.352117 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 556/1126] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:46:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:46:08.920057 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba044bab-acd4-423c-844c-98422d290607 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:46:08.921671 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-ba044bab-acd4-423c-844c-98422d290607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:46:08.934148 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba044bab-acd4-423c-844c-98422d290607 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:46:08.940726 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09975a-e19c-46af-b51e-fd7b3b13097e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:46:08.941643 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09975a-e19c-46af-b51e-fd7b3b13097e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:08.941923 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09975a-e19c-46af-b51e-fd7b3b13097e admin admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:08.942197 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09975a-e19c-46af-b51e-fd7b3b13097e admin admin] PATH_INFO: `/v3/projects/ea9b5240e1c54fb8a19b7666b6a81aab` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:08.943373 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09975a-e19c-46af-b51e-fd7b3b13097e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea9b5240e1c54fb8a19b7666b6a81aab)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:46:08.949051 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: WARNING py.warnings [None req-0b09975a-e19c-46af-b51e-fd7b3b13097e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:46:08.949051 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: warnings.warn(msg) Aug 22 20:46:08.949051 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: Aug 22 20:46:08.949051 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09975a-e19c-46af-b51e-fd7b3b13097e admin admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:46:09.178426 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-0b09975a-e19c-46af-b51e-fd7b3b13097e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9b5240e1c54fb8a19b7666b6a81aab', 'request_id': 'req-0b09975a-e19c-46af-b51e-fd7b3b13097e'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:46:09.192566 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-0b09975a-e19c-46af-b51e-fd7b3b13097e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9b5240e1c54fb8a19b7666b6a81aab', 'request_id': 'req-0b09975a-e19c-46af-b51e-fd7b3b13097e'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:46:09.199116 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-0b09975a-e19c-46af-b51e-fd7b3b13097e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9b5240e1c54fb8a19b7666b6a81aab', 'request_id': 'req-0b09975a-e19c-46af-b51e-fd7b3b13097e'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:46:09.337303 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-0b09975a-e19c-46af-b51e-fd7b3b13097e admin admin] The token cache is being invalidate because project ea9b5240e1c54fb8a19b7666b6a81aab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:46:09.337599 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-0b09975a-e19c-46af-b51e-fd7b3b13097e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:46:09.338294 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-0b09975a-e19c-46af-b51e-fd7b3b13097e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:46:09.339994 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 571/1127] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 20:46:08 2022] DELETE /identity/v3/projects/ea9b5240e1c54fb8a19b7666b6a81aab => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:46:18.348041 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:46:19.333895 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:47:37.336517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c04275-3256-48d6-b7b3-1355f79b0bb7 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:37.337108 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c04275-3256-48d6-b7b3-1355f79b0bb7 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:37.337108 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c04275-3256-48d6-b7b3-1355f79b0bb7 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:37.338409 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 557/1128] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:47:37.343254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f5d05-1630-4997-9efc-23a6aae1e772 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:37.343736 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f5d05-1630-4997-9efc-23a6aae1e772 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:37.343833 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f5d05-1630-4997-9efc-23a6aae1e772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:37.364178 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-271f5d05-1630-4997-9efc-23a6aae1e772 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:47:37.365402 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-271f5d05-1630-4997-9efc-23a6aae1e772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:47:37.425767 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 572/1129] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:47:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:47:37.585494 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c04275-3256-48d6-b7b3-1355f79b0bb7 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:47:37.587250 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-71c04275-3256-48d6-b7b3-1355f79b0bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:47:37.660746 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c04275-3256-48d6-b7b3-1355f79b0bb7 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:47:37.665855 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3463b14-9f19-42e7-b1bd-a7e7df44c434 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:47:37.666460 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3463b14-9f19-42e7-b1bd-a7e7df44c434 service nova] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:37.666741 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3463b14-9f19-42e7-b1bd-a7e7df44c434 service nova] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:37.667016 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3463b14-9f19-42e7-b1bd-a7e7df44c434 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:37.675981 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3463b14-9f19-42e7-b1bd-a7e7df44c434 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:47:37.678931 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3463b14-9f19-42e7-b1bd-a7e7df44c434 service nova] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:47:37.687147 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 558/1130] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:47:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:47:38.529018 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7348d6-2c94-4816-93b4-3d3636f25b5b None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:38.529541 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7348d6-2c94-4816-93b4-3d3636f25b5b None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:38.529541 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7348d6-2c94-4816-93b4-3d3636f25b5b None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:38.531008 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 573/1131] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:47:38.536248 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d8ece-7e6d-4974-9f34-3be937787a22 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:38.536654 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d8ece-7e6d-4974-9f34-3be937787a22 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:38.536769 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d8ece-7e6d-4974-9f34-3be937787a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:38.556031 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-364d8ece-7e6d-4974-9f34-3be937787a22 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:47:38.557240 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-364d8ece-7e6d-4974-9f34-3be937787a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:47:38.565412 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 559/1132] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:47:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:47:38.723923 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7348d6-2c94-4816-93b4-3d3636f25b5b None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:47:38.737706 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7348d6-2c94-4816-93b4-3d3636f25b5b None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:47:38.742756 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b6b6c-783c-4d47-8ce7-f62150b4511b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:47:38.743394 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b6b6c-783c-4d47-8ce7-f62150b4511b service nova] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:38.743715 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b6b6c-783c-4d47-8ce7-f62150b4511b service nova] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:38.743994 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b6b6c-783c-4d47-8ce7-f62150b4511b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:38.753155 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b6b6c-783c-4d47-8ce7-f62150b4511b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:47:38.754839 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b6b6c-783c-4d47-8ce7-f62150b4511b service nova] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:47:38.764802 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 574/1133] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:47:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:47:43.216704 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce50df-40ed-4b74-9168-7e818217be85 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:43.217258 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce50df-40ed-4b74-9168-7e818217be85 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:43.217258 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce50df-40ed-4b74-9168-7e818217be85 None None] PATH_INFO: `/v3` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:43.218516 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 560/1134] 10.222.0.65 () {54 vars in 925 bytes} [Mon Aug 22 20:47:43 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:47:43.225379 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac57df4-d0b6-4d26-95bf-aae0563acfb7 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:43.225996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac57df4-d0b6-4d26-95bf-aae0563acfb7 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:43.225996 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac57df4-d0b6-4d26-95bf-aae0563acfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:43.245791 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-2ac57df4-d0b6-4d26-95bf-aae0563acfb7 None None] MFA Rules not processed for user `e4117090fe4047f9b6a2b5eab5ff218c`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:47:43.247019 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-2ac57df4-d0b6-4d26-95bf-aae0563acfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:47:43.309529 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 575/1135] 10.222.0.65 () {58 vars in 1015 bytes} [Mon Aug 22 20:47:43 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:47:47.599449 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc308879-edc2-40d3-85f6-8b0283e07c99 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:47.600079 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc308879-edc2-40d3-85f6-8b0283e07c99 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:47.600079 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc308879-edc2-40d3-85f6-8b0283e07c99 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:47.601698 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 561/1136] 10.222.0.15 () {54 vars in 961 bytes} [Mon Aug 22 20:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:47:47.607368 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d680e-8716-43db-ba8a-7a87b9256a5f None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:47.607920 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d680e-8716-43db-ba8a-7a87b9256a5f None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:47.608022 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d680e-8716-43db-ba8a-7a87b9256a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:47.629678 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-a37d680e-8716-43db-ba8a-7a87b9256a5f None None] MFA Rules not processed for user `e4117090fe4047f9b6a2b5eab5ff218c`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:47:47.631242 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-a37d680e-8716-43db-ba8a-7a87b9256a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:47:47.640478 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 576/1137] 10.222.0.15 () {58 vars in 1058 bytes} [Mon Aug 22 20:47:47 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:47:47.648003 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc308879-edc2-40d3-85f6-8b0283e07c99 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:47:47.662169 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc308879-edc2-40d3-85f6-8b0283e07c99 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:47:47.667413 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141aea9-2d27-4d98-a816-b64523b3dfc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4117090fe4047f9b6a2b5eab5ff218c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:47:47.668071 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141aea9-2d27-4d98-a816-b64523b3dfc9 service placement] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:47.668350 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141aea9-2d27-4d98-a816-b64523b3dfc9 service placement] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:47.668624 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141aea9-2d27-4d98-a816-b64523b3dfc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:47.678583 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141aea9-2d27-4d98-a816-b64523b3dfc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:47:47.680261 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141aea9-2d27-4d98-a816-b64523b3dfc9 service placement] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:47:47.691235 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 562/1138] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:47:47 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:47:50.020227 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51656a0b-ee7f-431a-8db4-d54544783af8 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:50.020813 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51656a0b-ee7f-431a-8db4-d54544783af8 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:50.020813 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51656a0b-ee7f-431a-8db4-d54544783af8 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:50.022144 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 577/1139] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:47:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:47:50.027197 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b2ce7-601f-477c-9ed6-4e7bde99f6f7 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:50.027734 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b2ce7-601f-477c-9ed6-4e7bde99f6f7 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:50.027850 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b2ce7-601f-477c-9ed6-4e7bde99f6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:50.047244 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-d42b2ce7-601f-477c-9ed6-4e7bde99f6f7 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:47:50.048493 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-d42b2ce7-601f-477c-9ed6-4e7bde99f6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:47:50.056460 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 563/1140] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:47:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:47:50.223964 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51656a0b-ee7f-431a-8db4-d54544783af8 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:47:50.240456 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51656a0b-ee7f-431a-8db4-d54544783af8 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:47:50.246574 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c41f2-ceb7-4b76-bf1f-3a816785b549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:47:50.247442 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c41f2-ceb7-4b76-bf1f-3a816785b549 service nova] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:50.247872 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c41f2-ceb7-4b76-bf1f-3a816785b549 service nova] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:50.248264 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c41f2-ceb7-4b76-bf1f-3a816785b549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:50.260484 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c41f2-ceb7-4b76-bf1f-3a816785b549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:47:50.263143 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c41f2-ceb7-4b76-bf1f-3a816785b549 service nova] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:47:50.276230 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 578/1141] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:47:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:47:51.116159 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03dd4d-d373-422e-9eb8-68ba77d4a1e0 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:51.116666 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03dd4d-d373-422e-9eb8-68ba77d4a1e0 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:51.116666 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03dd4d-d373-422e-9eb8-68ba77d4a1e0 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:51.117970 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 564/1142] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:47:51.122865 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bd171-10d9-410d-aab2-42c1bbe30747 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:51.123299 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bd171-10d9-410d-aab2-42c1bbe30747 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:51.123418 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bd171-10d9-410d-aab2-42c1bbe30747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:51.144625 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-bd8bd171-10d9-410d-aab2-42c1bbe30747 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:47:51.145835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-bd8bd171-10d9-410d-aab2-42c1bbe30747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:47:51.153624 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 579/1143] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:47:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:47:51.310323 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03dd4d-d373-422e-9eb8-68ba77d4a1e0 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:47:51.324291 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03dd4d-d373-422e-9eb8-68ba77d4a1e0 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:47:51.329295 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e426f-634d-4300-a46d-11fabfe63a11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:47:51.329911 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e426f-634d-4300-a46d-11fabfe63a11 service nova] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:51.330193 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e426f-634d-4300-a46d-11fabfe63a11 service nova] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:51.330470 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e426f-634d-4300-a46d-11fabfe63a11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:51.338654 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e426f-634d-4300-a46d-11fabfe63a11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:47:51.340385 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e426f-634d-4300-a46d-11fabfe63a11 service nova] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:47:51.350214 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 565/1144] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:47:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:47:55.641446 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5f544-32da-448d-8bd7-eb860f366b7a None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:55.642067 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5f544-32da-448d-8bd7-eb860f366b7a None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:55.642067 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5f544-32da-448d-8bd7-eb860f366b7a None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:55.643338 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 580/1145] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:47:55.648705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f821d-0aa5-41ba-96ee-fcbd7afba2b7 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:55.649189 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f821d-0aa5-41ba-96ee-fcbd7afba2b7 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:55.649292 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f821d-0aa5-41ba-96ee-fcbd7afba2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:55.668348 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-2a3f821d-0aa5-41ba-96ee-fcbd7afba2b7 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:47:55.669541 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-2a3f821d-0aa5-41ba-96ee-fcbd7afba2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:47:55.677840 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 566/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:47:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:47:56.025589 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5f544-32da-448d-8bd7-eb860f366b7a None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:47:56.027319 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-3ef5f544-32da-448d-8bd7-eb860f366b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:47:56.086730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5f544-32da-448d-8bd7-eb860f366b7a None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:47:56.090305 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66abef-032d-445f-abe1-edee4af55b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:47:56.097964 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66abef-032d-445f-abe1-edee4af55b35 service neutron] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:56.097964 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66abef-032d-445f-abe1-edee4af55b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:56.097964 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66abef-032d-445f-abe1-edee4af55b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:56.100802 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66abef-032d-445f-abe1-edee4af55b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:47:56.102239 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66abef-032d-445f-abe1-edee4af55b35 service neutron] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:47:56.107130 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=100 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:47:56.111695 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 581/1147] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:47:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:47:58.282562 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b067ab-a987-4560-8df9-4f372083b1a7 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:58.283128 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b067ab-a987-4560-8df9-4f372083b1a7 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:58.283128 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b067ab-a987-4560-8df9-4f372083b1a7 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:58.284459 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 567/1148] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:47:58.289767 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ce9c7-76f9-4596-b935-21c7ab8a8626 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:58.290232 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ce9c7-76f9-4596-b935-21c7ab8a8626 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:58.290339 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ce9c7-76f9-4596-b935-21c7ab8a8626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:58.309688 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-268ce9c7-76f9-4596-b935-21c7ab8a8626 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:47:58.310903 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-268ce9c7-76f9-4596-b935-21c7ab8a8626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:47:58.319555 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 582/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:47:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:47:58.666553 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b067ab-a987-4560-8df9-4f372083b1a7 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:47:58.672045 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=54 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:47:58.678301 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b067ab-a987-4560-8df9-4f372083b1a7 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:47:58.682057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f38e1-dac6-427e-97ed-6988e9951bde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:47:58.686905 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f38e1-dac6-427e-97ed-6988e9951bde service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:58.686905 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f38e1-dac6-427e-97ed-6988e9951bde service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:58.686905 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f38e1-dac6-427e-97ed-6988e9951bde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:58.692589 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f38e1-dac6-427e-97ed-6988e9951bde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:47:58.694317 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f38e1-dac6-427e-97ed-6988e9951bde service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:47:58.703901 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 568/1150] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:47:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:48:02.811925 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef1cdc-4595-4f31-a3d5-30929beb24f4 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:48:02.812516 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef1cdc-4595-4f31-a3d5-30929beb24f4 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:48:02.812516 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef1cdc-4595-4f31-a3d5-30929beb24f4 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:48:02.813831 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 583/1151] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:48:02.820002 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1cc1c-ce59-49d8-859c-b193de0cd315 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:48:02.820501 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1cc1c-ce59-49d8-859c-b193de0cd315 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:48:02.820609 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1cc1c-ce59-49d8-859c-b193de0cd315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:48:02.840685 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-0af1cc1c-ce59-49d8-859c-b193de0cd315 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:48:02.841935 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-0af1cc1c-ce59-49d8-859c-b193de0cd315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:48:02.850463 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 569/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:48:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:48:03.443979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef1cdc-4595-4f31-a3d5-30929beb24f4 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:48:03.445988 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-d3ef1cdc-4595-4f31-a3d5-30929beb24f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:48:03.504578 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef1cdc-4595-4f31-a3d5-30929beb24f4 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:48:03.508196 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cef16-2207-48fb-810c-b8b155c52620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0b7833b75334bceb549f7184041aacc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:48:03.508798 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cef16-2207-48fb-810c-b8b155c52620 service cinder] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:48:03.509081 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cef16-2207-48fb-810c-b8b155c52620 service cinder] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:48:03.509361 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cef16-2207-48fb-810c-b8b155c52620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:48:03.518307 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3cef16-2207-48fb-810c-b8b155c52620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:48:03.519845 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3cef16-2207-48fb-810c-b8b155c52620 service cinder] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:48:03.529685 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 584/1153] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:48:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:48:05.769742 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e5ac9-6d0c-42f8-87ed-bea22bc882fd None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:48:05.770312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e5ac9-6d0c-42f8-87ed-bea22bc882fd None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:48:05.770312 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e5ac9-6d0c-42f8-87ed-bea22bc882fd None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:48:05.771718 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 570/1154] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:48:05.777043 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07d00d-bd0e-4328-97a1-c8b608ddfbb4 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:48:05.777490 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07d00d-bd0e-4328-97a1-c8b608ddfbb4 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:48:05.777634 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07d00d-bd0e-4328-97a1-c8b608ddfbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:48:05.798689 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-fb07d00d-bd0e-4328-97a1-c8b608ddfbb4 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:48:05.799912 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-fb07d00d-bd0e-4328-97a1-c8b608ddfbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:48:05.809552 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 585/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:48:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:48:06.381029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e5ac9-6d0c-42f8-87ed-bea22bc882fd None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:48:06.382774 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-297e5ac9-6d0c-42f8-87ed-bea22bc882fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:48:06.395885 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e5ac9-6d0c-42f8-87ed-bea22bc882fd None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:48:06.399417 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4e811-f677-44b7-a840-51dfcc4dabc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0b7833b75334bceb549f7184041aacc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:48:06.400037 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4e811-f677-44b7-a840-51dfcc4dabc8 service cinder] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:48:06.400318 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4e811-f677-44b7-a840-51dfcc4dabc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:48:06.400596 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4e811-f677-44b7-a840-51dfcc4dabc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:48:06.409628 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4e811-f677-44b7-a840-51dfcc4dabc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:48:06.411666 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4e811-f677-44b7-a840-51dfcc4dabc8 service cinder] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:48:06.421444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 571/1156] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:48:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:48:15.793361 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=32 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:48:16.417228 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=14 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:49:22.903452 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febda084-abcb-4cf7-a74c-e37d09013c81 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:22.904171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febda084-abcb-4cf7-a74c-e37d09013c81 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:22.904171 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febda084-abcb-4cf7-a74c-e37d09013c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:22.923483 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-febda084-abcb-4cf7-a74c-e37d09013c81 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:22.928852 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec3dd8-7bef-42af-8658-5c119c4b1481 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:22.929501 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec3dd8-7bef-42af-8658-5c119c4b1481 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:22.929616 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec3dd8-7bef-42af-8658-5c119c4b1481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:22.937843 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-febda084-abcb-4cf7-a74c-e37d09013c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:22.946993 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 586/1157] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 20:49:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:49:22.953412 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-0fec3dd8-7bef-42af-8658-5c119c4b1481 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:22.954678 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-0fec3dd8-7bef-42af-8658-5c119c4b1481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:22.955379 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbaae6-e132-4733-ab8e-2ff2810edaab None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:22.955698 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbaae6-e132-4733-ab8e-2ff2810edaab None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:22.955972 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbaae6-e132-4733-ab8e-2ff2810edaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:22.964691 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 572/1158] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 20:49:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:49:22.975461 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc587cba-414d-4dea-8eeb-dbb2f0a75409 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:22.975784 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc587cba-414d-4dea-8eeb-dbb2f0a75409 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:22.976065 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc587cba-414d-4dea-8eeb-dbb2f0a75409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:22.978967 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-d8cbaae6-e132-4733-ab8e-2ff2810edaab None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:22.980215 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-d8cbaae6-e132-4733-ab8e-2ff2810edaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:22.989136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 587/1159] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 20:49:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:49:22.998319 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-fc587cba-414d-4dea-8eeb-dbb2f0a75409 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:23.000093 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-fc587cba-414d-4dea-8eeb-dbb2f0a75409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:23.004285 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbaae6-e132-4733-ab8e-2ff2810edaab None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:23.011649 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 573/1160] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 20:49:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:49:23.017612 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc587cba-414d-4dea-8eeb-dbb2f0a75409 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:23.024559 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbaae6-e132-4733-ab8e-2ff2810edaab None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:23.031083 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8a14c-3473-4d8f-8739-266b4f1be6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:23.032018 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc587cba-414d-4dea-8eeb-dbb2f0a75409 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:23.032181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8a14c-3473-4d8f-8739-266b4f1be6fb admin admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:23.032542 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8a14c-3473-4d8f-8739-266b4f1be6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:23.032964 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8a14c-3473-4d8f-8739-266b4f1be6fb admin admin] PATH_INFO: `/v3/domains` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:23.034136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8a14c-3473-4d8f-8739-266b4f1be6fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:49:23.034661 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8a14c-3473-4d8f-8739-266b4f1be6fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:23.038079 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe4ebe-ebde-4ed5-99a9-2719d88a655f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:23.038292 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8a14c-3473-4d8f-8739-266b4f1be6fb admin admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:23.038705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe4ebe-ebde-4ed5-99a9-2719d88a655f admin admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:23.038987 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe4ebe-ebde-4ed5-99a9-2719d88a655f admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:23.039299 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe4ebe-ebde-4ed5-99a9-2719d88a655f admin admin] PATH_INFO: `/v3/domains` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:23.040027 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe4ebe-ebde-4ed5-99a9-2719d88a655f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:49:23.040369 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe4ebe-ebde-4ed5-99a9-2719d88a655f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:23.041531 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: WARNING py.warnings [None req-eebe4ebe-ebde-4ed5-99a9-2719d88a655f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:49:23.041531 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: warnings.warn(msg) Aug 22 20:49:23.041531 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: Aug 22 20:49:23.042524 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe4ebe-ebde-4ed5-99a9-2719d88a655f admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:23.062069 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 574/1161] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 20:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:49:23.064803 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 588/1162] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 20:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:49:23.068186 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe4ebe-ebde-4ed5-99a9-2719d88a655f admin admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:23.070713 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8a14c-3473-4d8f-8739-266b4f1be6fb admin admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:23.081751 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe4ebe-ebde-4ed5-99a9-2719d88a655f admin admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:23.087326 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61163f-08ae-42af-ab74-37c3cf4952df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:23.088008 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61163f-08ae-42af-ab74-37c3cf4952df admin admin] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:23.088291 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61163f-08ae-42af-ab74-37c3cf4952df admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:23.088593 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61163f-08ae-42af-ab74-37c3cf4952df admin admin] PATH_INFO: `/v3/projects` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:23.089227 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61163f-08ae-42af-ab74-37c3cf4952df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:23.089583 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8a14c-3473-4d8f-8739-266b4f1be6fb admin admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:23.091262 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61163f-08ae-42af-ab74-37c3cf4952df admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:23.097917 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347cb1a-557f-4709-8174-f9f0449b7c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:23.099025 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347cb1a-557f-4709-8174-f9f0449b7c80 admin admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:23.099439 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347cb1a-557f-4709-8174-f9f0449b7c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:23.099954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347cb1a-557f-4709-8174-f9f0449b7c80 admin admin] PATH_INFO: `/v3/projects` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:23.101168 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347cb1a-557f-4709-8174-f9f0449b7c80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:23.103015 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: WARNING py.warnings [None req-b347cb1a-557f-4709-8174-f9f0449b7c80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:49:23.103015 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: warnings.warn(msg) Aug 22 20:49:23.103015 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: Aug 22 20:49:23.105447 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347cb1a-557f-4709-8174-f9f0449b7c80 admin admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:23.239419 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 575/1163] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 20:49:23 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:49:23.246172 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61163f-08ae-42af-ab74-37c3cf4952df admin admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:23.279991 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 589/1164] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 20:49:23 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:49:23.284652 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347cb1a-557f-4709-8174-f9f0449b7c80 admin admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:23.322006 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61163f-08ae-42af-ab74-37c3cf4952df admin admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:23.361274 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347cb1a-557f-4709-8174-f9f0449b7c80 admin admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:23.368072 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e5361-3a69-4214-8318-f0d27414736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:23.368855 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e5361-3a69-4214-8318-f0d27414736a admin admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:23.369172 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e5361-3a69-4214-8318-f0d27414736a admin admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:23.369457 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e5361-3a69-4214-8318-f0d27414736a admin admin] PATH_INFO: `/v3/users` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:23.370327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e5361-3a69-4214-8318-f0d27414736a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:23.372944 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e5361-3a69-4214-8318-f0d27414736a admin admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:23.400515 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d6811-505c-4df2-a0fb-cde091dea4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:23.403423 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d6811-505c-4df2-a0fb-cde091dea4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:23.403423 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d6811-505c-4df2-a0fb-cde091dea4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:23.403423 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d6811-505c-4df2-a0fb-cde091dea4b7 admin admin] PATH_INFO: `/v3/users` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:23.403423 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d6811-505c-4df2-a0fb-cde091dea4b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:23.404236 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: WARNING py.warnings [None req-3e6d6811-505c-4df2-a0fb-cde091dea4b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:49:23.404236 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: warnings.warn(msg) Aug 22 20:49:23.404236 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: Aug 22 20:49:23.405478 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d6811-505c-4df2-a0fb-cde091dea4b7 admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:23.514943 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 590/1165] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 20:49:23 2022] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:49:23.521025 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e5361-3a69-4214-8318-f0d27414736a admin admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:23.533657 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e5361-3a69-4214-8318-f0d27414736a admin admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:23.540248 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5762a-6254-4439-9fb6-425528c27397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:23.540885 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5762a-6254-4439-9fb6-425528c27397 admin admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:23.541165 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5762a-6254-4439-9fb6-425528c27397 admin admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:23.541440 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5762a-6254-4439-9fb6-425528c27397 admin admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:23.542100 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5762a-6254-4439-9fb6-425528c27397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:23.543781 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5762a-6254-4439-9fb6-425528c27397 admin admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:23.554899 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 591/1166] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 20:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:49:23.558992 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5762a-6254-4439-9fb6-425528c27397 admin admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:23.566165 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 576/1167] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 20:49:23 2022] POST /identity/v3/users => generated 289 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:49:23.570300 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d6811-505c-4df2-a0fb-cde091dea4b7 admin admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:23.570687 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5762a-6254-4439-9fb6-425528c27397 admin admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:23.576750 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ff4de-e71c-43f4-962d-ee4f247e356f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:23.576750 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ff4de-e71c-43f4-962d-ee4f247e356f admin admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:23.579484 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ff4de-e71c-43f4-962d-ee4f247e356f admin admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:23.579484 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ff4de-e71c-43f4-962d-ee4f247e356f admin admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:23.579484 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ff4de-e71c-43f4-962d-ee4f247e356f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:23.579484 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ff4de-e71c-43f4-962d-ee4f247e356f admin admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:23.582896 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d6811-505c-4df2-a0fb-cde091dea4b7 admin admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:23.588777 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6187b-b8fb-4ea3-b419-65fe17afbc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:23.589324 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6187b-b8fb-4ea3-b419-65fe17afbc80 admin admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:23.589604 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6187b-b8fb-4ea3-b419-65fe17afbc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:23.589883 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6187b-b8fb-4ea3-b419-65fe17afbc80 admin admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:23.590518 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6187b-b8fb-4ea3-b419-65fe17afbc80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:23.591396 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 592/1168] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 20:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:49:23.592383 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6187b-b8fb-4ea3-b419-65fe17afbc80 admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:23.600908 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ff4de-e71c-43f4-962d-ee4f247e356f admin admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:23.603835 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 577/1169] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 20:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:49:23.607682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6187b-b8fb-4ea3-b419-65fe17afbc80 admin admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:23.612893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ff4de-e71c-43f4-962d-ee4f247e356f admin admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:23.617644 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6187b-b8fb-4ea3-b419-65fe17afbc80 admin admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:23.617798 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a177340-e8b4-4af8-999f-561ebc7a284b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:23.618393 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a177340-e8b4-4af8-999f-561ebc7a284b admin admin] REQUEST_METHOD: `PUT` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:23.618675 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a177340-e8b4-4af8-999f-561ebc7a284b admin admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:23.618952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a177340-e8b4-4af8-999f-561ebc7a284b admin admin] PATH_INFO: `/v3/projects/9d2e90e5da7e4b92bbda1722a3032f14/users/f913484e666c4cd5af84155d4c590b55/roles/910e8004690649e3b4fc1c4be76ad967` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:23.622394 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac5d32-fcaa-4db0-ab77-32912680c769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:23.623008 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac5d32-fcaa-4db0-ab77-32912680c769 admin admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:23.623291 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac5d32-fcaa-4db0-ab77-32912680c769 admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:23.623598 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac5d32-fcaa-4db0-ab77-32912680c769 admin admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:23.624274 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac5d32-fcaa-4db0-ab77-32912680c769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:23.625946 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac5d32-fcaa-4db0-ab77-32912680c769 admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:23.636860 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a177340-e8b4-4af8-999f-561ebc7a284b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d2e90e5da7e4b92bbda1722a3032f14, user_id=f913484e666c4cd5af84155d4c590b55, role_id=910e8004690649e3b4fc1c4be76ad967)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:23.640973 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 578/1170] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 20:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:49:23.641108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: WARNING py.warnings [None req-1a177340-e8b4-4af8-999f-561ebc7a284b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:49:23.641108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: warnings.warn(msg) Aug 22 20:49:23.641108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: Aug 22 20:49:23.641108 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a177340-e8b4-4af8-999f-561ebc7a284b admin admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:23.641720 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac5d32-fcaa-4db0-ab77-32912680c769 admin admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:23.652574 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac5d32-fcaa-4db0-ab77-32912680c769 admin admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:23.659909 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f25f4-96b2-4795-aec5-eb62c5614de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:23.660594 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f25f4-96b2-4795-aec5-eb62c5614de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:23.660878 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f25f4-96b2-4795-aec5-eb62c5614de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:23.661154 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f25f4-96b2-4795-aec5-eb62c5614de3 admin admin] PATH_INFO: `/v3/projects/606319096e0a4732a32d5262dd17ba73/users/34b40b44acdb4f978e2d8c9416bc50ad/roles/910e8004690649e3b4fc1c4be76ad967` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:23.679311 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f25f4-96b2-4795-aec5-eb62c5614de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=606319096e0a4732a32d5262dd17ba73, user_id=34b40b44acdb4f978e2d8c9416bc50ad, role_id=910e8004690649e3b4fc1c4be76ad967)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:23.682057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f25f4-96b2-4795-aec5-eb62c5614de3 admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:23.778593 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 593/1171] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 20:49:23 2022] PUT /identity/v3/projects/9d2e90e5da7e4b92bbda1722a3032f14/users/f913484e666c4cd5af84155d4c590b55/roles/910e8004690649e3b4fc1c4be76ad967 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:49:23.783915 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996e522-949f-4066-a170-07c6a49f25eb None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:23.784213 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996e522-949f-4066-a170-07c6a49f25eb None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:23.784479 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996e522-949f-4066-a170-07c6a49f25eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:23.803832 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-b996e522-949f-4066-a170-07c6a49f25eb None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:23.805097 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-b996e522-949f-4066-a170-07c6a49f25eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:23.812937 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 579/1172] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 20:49:23 2022] PUT /identity/v3/projects/606319096e0a4732a32d5262dd17ba73/users/34b40b44acdb4f978e2d8c9416bc50ad/roles/910e8004690649e3b4fc1c4be76ad967 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:49:23.820525 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ce41b-57f6-4fbc-9e81-d8cac9cbd381 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:23.820984 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ce41b-57f6-4fbc-9e81-d8cac9cbd381 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:23.821407 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ce41b-57f6-4fbc-9e81-d8cac9cbd381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:23.832630 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:49:23.849859 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-956ce41b-57f6-4fbc-9e81-d8cac9cbd381 None None] MFA Rules not processed for user `146ec9a584bf4142acfd366d51db1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:23.851307 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-956ce41b-57f6-4fbc-9e81-d8cac9cbd381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:23.866972 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:49:23.891254 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 594/1173] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 20:49:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:49:23.902384 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996e522-949f-4066-a170-07c6a49f25eb None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:23.927334 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 580/1174] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 20:49:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:49:23.941360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ce41b-57f6-4fbc-9e81-d8cac9cbd381 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:23.998530 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996e522-949f-4066-a170-07c6a49f25eb None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:24.004969 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bc1ab-4e03-48dd-98ad-f20c2149ecca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:24.005680 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ce41b-57f6-4fbc-9e81-d8cac9cbd381 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:24.006046 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bc1ab-4e03-48dd-98ad-f20c2149ecca service neutron] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:24.007086 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bc1ab-4e03-48dd-98ad-f20c2149ecca service neutron] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:24.007539 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bc1ab-4e03-48dd-98ad-f20c2149ecca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:24.010256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55945180-9545-464d-ae42-98ea8cb511ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:24.010926 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55945180-9545-464d-ae42-98ea8cb511ec service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:24.011208 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55945180-9545-464d-ae42-98ea8cb511ec service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:24.011482 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55945180-9545-464d-ae42-98ea8cb511ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:24.024651 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bc1ab-4e03-48dd-98ad-f20c2149ecca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:24.024929 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55945180-9545-464d-ae42-98ea8cb511ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:24.027533 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bc1ab-4e03-48dd-98ad-f20c2149ecca service neutron] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:24.027750 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55945180-9545-464d-ae42-98ea8cb511ec service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:24.045347 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 595/1175] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:49:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:49:24.047969 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 581/1176] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:49:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:49:32.380251 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa63cc-e781-4224-a7e3-9c9afa92f208 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:32.380933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa63cc-e781-4224-a7e3-9c9afa92f208 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:32.381075 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa63cc-e781-4224-a7e3-9c9afa92f208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:32.422564 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-21fa63cc-e781-4224-a7e3-9c9afa92f208 None None] MFA Rules not processed for user `f913484e666c4cd5af84155d4c590b55`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:32.423869 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-21fa63cc-e781-4224-a7e3-9c9afa92f208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:32.560444 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 596/1177] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 20:49:32 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:49:32.577602 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55945180-9545-464d-ae42-98ea8cb511ec service neutron] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:32.601169 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55945180-9545-464d-ae42-98ea8cb511ec service neutron] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:32.609709 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886959c-9ed4-46b9-bf86-1c2b42f7309f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:32.609709 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886959c-9ed4-46b9-bf86-1c2b42f7309f admin admin] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:32.609709 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886959c-9ed4-46b9-bf86-1c2b42f7309f admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:32.609709 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886959c-9ed4-46b9-bf86-1c2b42f7309f admin admin] PATH_INFO: `/v3/projects` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:32.610229 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886959c-9ed4-46b9-bf86-1c2b42f7309f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:32.616541 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886959c-9ed4-46b9-bf86-1c2b42f7309f admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:32.746335 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95a9e3-46f5-4f56-8429-e0361987f2af None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:32.746710 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95a9e3-46f5-4f56-8429-e0361987f2af None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:32.747086 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95a9e3-46f5-4f56-8429-e0361987f2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:32.768714 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 582/1178] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 20:49:32 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:49:32.774738 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886959c-9ed4-46b9-bf86-1c2b42f7309f admin admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:32.803074 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-9f95a9e3-46f5-4f56-8429-e0361987f2af None None] MFA Rules not processed for user `34b40b44acdb4f978e2d8c9416bc50ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:32.804646 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-9f95a9e3-46f5-4f56-8429-e0361987f2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:32.910821 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886959c-9ed4-46b9-bf86-1c2b42f7309f admin admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:32.918672 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55d28f-9c56-417b-8813-77b49ddc37c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:32.919681 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55d28f-9c56-417b-8813-77b49ddc37c7 admin admin] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:32.919979 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55d28f-9c56-417b-8813-77b49ddc37c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:32.920485 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55d28f-9c56-417b-8813-77b49ddc37c7 admin admin] PATH_INFO: `/v3/users` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:32.925391 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55d28f-9c56-417b-8813-77b49ddc37c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:32.925391 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55d28f-9c56-417b-8813-77b49ddc37c7 admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:32.930592 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 597/1179] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 20:49:32 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:49:32.932197 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95a9e3-46f5-4f56-8429-e0361987f2af None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:32.944700 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95a9e3-46f5-4f56-8429-e0361987f2af None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:32.951023 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257e598-6153-4705-a8d2-61fd06864293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:32.954684 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257e598-6153-4705-a8d2-61fd06864293 admin admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:32.954684 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257e598-6153-4705-a8d2-61fd06864293 admin admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:32.954684 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257e598-6153-4705-a8d2-61fd06864293 admin admin] PATH_INFO: `/v3/projects` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:32.954684 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257e598-6153-4705-a8d2-61fd06864293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:32.955588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257e598-6153-4705-a8d2-61fd06864293 admin admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:32.974882 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:49:33.071253 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 583/1180] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 20:49:32 2022] POST /identity/v3/users => generated 299 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:49:33.077384 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55d28f-9c56-417b-8813-77b49ddc37c7 admin admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:33.089656 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55d28f-9c56-417b-8813-77b49ddc37c7 admin admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:33.095257 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82165c-8501-483e-82ab-29db09a6e9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:33.096038 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82165c-8501-483e-82ab-29db09a6e9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:33.096531 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82165c-8501-483e-82ab-29db09a6e9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:33.096702 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82165c-8501-483e-82ab-29db09a6e9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:33.106308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82165c-8501-483e-82ab-29db09a6e9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:33.106308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82165c-8501-483e-82ab-29db09a6e9a0 admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:33.112824 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 584/1181] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 20:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:49:33.117698 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82165c-8501-483e-82ab-29db09a6e9a0 admin admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:33.133660 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:49:33.140440 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 598/1182] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 20:49:32 2022] POST /identity/v3/projects => generated 379 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:49:33.141815 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257e598-6153-4705-a8d2-61fd06864293 admin admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:33.147792 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82165c-8501-483e-82ab-29db09a6e9a0 admin admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:33.237305 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257e598-6153-4705-a8d2-61fd06864293 admin admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:33.243508 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c4848-a53d-412e-9291-e4cef4058d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:33.244281 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c4848-a53d-412e-9291-e4cef4058d3a admin admin] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:33.244683 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c4848-a53d-412e-9291-e4cef4058d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:33.245063 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c4848-a53d-412e-9291-e4cef4058d3a admin admin] PATH_INFO: `/v3/users` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:33.245922 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c4848-a53d-412e-9291-e4cef4058d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:33.251207 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c4848-a53d-412e-9291-e4cef4058d3a admin admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:33.264936 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3578c-350b-416b-b3c6-bd95ae26ce81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:33.264936 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3578c-350b-416b-b3c6-bd95ae26ce81 admin admin] REQUEST_METHOD: `PUT` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:33.264936 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3578c-350b-416b-b3c6-bd95ae26ce81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:33.264936 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3578c-350b-416b-b3c6-bd95ae26ce81 admin admin] PATH_INFO: `/v3/projects/23a464497a3d495b93fd6da1fac46f6a/users/b7533efc8c024df4adb7e196f892252a/roles/1e3ce9c8b9934a7bb515b39e21fc1d68` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:33.287931 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3578c-350b-416b-b3c6-bd95ae26ce81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a464497a3d495b93fd6da1fac46f6a, user_id=b7533efc8c024df4adb7e196f892252a, role_id=1e3ce9c8b9934a7bb515b39e21fc1d68)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:33.295421 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3578c-350b-416b-b3c6-bd95ae26ce81 admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:33.403804 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 599/1183] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 20:49:33 2022] POST /identity/v3/users => generated 296 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:49:33.407427 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c4848-a53d-412e-9291-e4cef4058d3a admin admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:33.427720 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c4848-a53d-412e-9291-e4cef4058d3a admin admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:33.434723 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb22485-3626-495b-984e-9f6eae884259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:33.435826 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb22485-3626-495b-984e-9f6eae884259 admin admin] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:33.436273 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb22485-3626-495b-984e-9f6eae884259 admin admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:33.437031 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb22485-3626-495b-984e-9f6eae884259 admin admin] PATH_INFO: `/v3/roles` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:33.438560 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb22485-3626-495b-984e-9f6eae884259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:33.442479 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb22485-3626-495b-984e-9f6eae884259 admin admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:33.451617 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 585/1184] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 20:49:33 2022] PUT /identity/v3/projects/23a464497a3d495b93fd6da1fac46f6a/users/b7533efc8c024df4adb7e196f892252a/roles/1e3ce9c8b9934a7bb515b39e21fc1d68 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:49:33.458941 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3578c-350b-416b-b3c6-bd95ae26ce81 admin admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:33.482969 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 600/1185] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 20:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:49:33.490338 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb22485-3626-495b-984e-9f6eae884259 admin admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:33.520006 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb22485-3626-495b-984e-9f6eae884259 admin admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:33.612892 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3578c-350b-416b-b3c6-bd95ae26ce81 admin admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:33.623740 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb137e-6b9b-44bb-a8ef-42ecdd4bf126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:33.627494 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb137e-6b9b-44bb-a8ef-42ecdd4bf126 admin admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:33.632114 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb137e-6b9b-44bb-a8ef-42ecdd4bf126 admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:33.632114 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb137e-6b9b-44bb-a8ef-42ecdd4bf126 admin admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:33.632114 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb137e-6b9b-44bb-a8ef-42ecdd4bf126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:33.639103 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb137e-6b9b-44bb-a8ef-42ecdd4bf126 admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:33.665988 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8378f6-439f-4f3b-8139-d2041414d9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:33.667679 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8378f6-439f-4f3b-8139-d2041414d9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:33.668297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8378f6-439f-4f3b-8139-d2041414d9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:33.668877 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8378f6-439f-4f3b-8139-d2041414d9b5 admin admin] PATH_INFO: `/v3/projects/24747e8df9554b86af7e012c303b9ad6/users/c321301f4abf4c71b0f6717b4fcc2090/roles/1e3ce9c8b9934a7bb515b39e21fc1d68` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:33.676739 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 586/1186] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 20:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:49:33.678965 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb137e-6b9b-44bb-a8ef-42ecdd4bf126 admin admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:33.716993 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8378f6-439f-4f3b-8139-d2041414d9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24747e8df9554b86af7e012c303b9ad6, user_id=c321301f4abf4c71b0f6717b4fcc2090, role_id=1e3ce9c8b9934a7bb515b39e21fc1d68)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:33.721548 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb137e-6b9b-44bb-a8ef-42ecdd4bf126 admin admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:33.722949 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8378f6-439f-4f3b-8139-d2041414d9b5 admin admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:33.728816 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a21469-767c-402d-9e9c-c0a8a0cff10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:33.729913 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a21469-767c-402d-9e9c-c0a8a0cff10f admin admin] REQUEST_METHOD: `PUT` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:33.730424 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a21469-767c-402d-9e9c-c0a8a0cff10f admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:33.731070 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a21469-767c-402d-9e9c-c0a8a0cff10f admin admin] PATH_INFO: `/v3/projects/23a464497a3d495b93fd6da1fac46f6a/users/b7533efc8c024df4adb7e196f892252a/roles/1e3ce9c8b9934a7bb515b39e21fc1d68` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:33.733594 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a21469-767c-402d-9e9c-c0a8a0cff10f admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a464497a3d495b93fd6da1fac46f6a, user_id=b7533efc8c024df4adb7e196f892252a, role_id=1e3ce9c8b9934a7bb515b39e21fc1d68)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:33.737071 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a21469-767c-402d-9e9c-c0a8a0cff10f admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:33.754691 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 587/1187] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 20:49:33 2022] PUT /identity/v3/projects/23a464497a3d495b93fd6da1fac46f6a/users/b7533efc8c024df4adb7e196f892252a/roles/1e3ce9c8b9934a7bb515b39e21fc1d68 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:49:33.809618 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 601/1188] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 20:49:33 2022] PUT /identity/v3/projects/24747e8df9554b86af7e012c303b9ad6/users/c321301f4abf4c71b0f6717b4fcc2090/roles/1e3ce9c8b9934a7bb515b39e21fc1d68 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:49:33.813504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a21469-767c-402d-9e9c-c0a8a0cff10f admin admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:33.963000 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a21469-767c-402d-9e9c-c0a8a0cff10f admin admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:33.996331 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:49:34.077118 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660e7bd-0a79-49d4-8c7f-5e049f3d6752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:34.077118 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660e7bd-0a79-49d4-8c7f-5e049f3d6752 admin admin] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:34.077118 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660e7bd-0a79-49d4-8c7f-5e049f3d6752 admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:34.077118 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660e7bd-0a79-49d4-8c7f-5e049f3d6752 admin admin] PATH_INFO: `/v3/roles` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:34.078705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660e7bd-0a79-49d4-8c7f-5e049f3d6752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:34.082992 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660e7bd-0a79-49d4-8c7f-5e049f3d6752 admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:34.116496 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8378f6-439f-4f3b-8139-d2041414d9b5 admin admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:34.120491 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 588/1189] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 20:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:49:34.129392 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8378f6-439f-4f3b-8139-d2041414d9b5 admin admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:34.134614 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06728df-bcbe-4782-96f0-fdde2b53e853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:34.135510 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06728df-bcbe-4782-96f0-fdde2b53e853 admin admin] REQUEST_METHOD: `PUT` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:34.135973 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06728df-bcbe-4782-96f0-fdde2b53e853 admin admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:34.136658 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06728df-bcbe-4782-96f0-fdde2b53e853 admin admin] PATH_INFO: `/v3/projects/24747e8df9554b86af7e012c303b9ad6/users/c321301f4abf4c71b0f6717b4fcc2090/roles/1e3ce9c8b9934a7bb515b39e21fc1d68` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:34.138999 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06728df-bcbe-4782-96f0-fdde2b53e853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24747e8df9554b86af7e012c303b9ad6, user_id=c321301f4abf4c71b0f6717b4fcc2090, role_id=1e3ce9c8b9934a7bb515b39e21fc1d68)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:34.151520 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06728df-bcbe-4782-96f0-fdde2b53e853 admin admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:34.161982 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 602/1190] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 20:49:34 2022] PUT /identity/v3/projects/24747e8df9554b86af7e012c303b9ad6/users/c321301f4abf4c71b0f6717b4fcc2090/roles/1e3ce9c8b9934a7bb515b39e21fc1d68 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:49:43.971150 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a381a-c41d-4372-a90a-62ec0486cd9f None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:43.971837 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a381a-c41d-4372-a90a-62ec0486cd9f None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:43.972135 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a381a-c41d-4372-a90a-62ec0486cd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:44.023835 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-c48a381a-c41d-4372-a90a-62ec0486cd9f None None] MFA Rules not processed for user `b7533efc8c024df4adb7e196f892252a`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:44.025586 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-c48a381a-c41d-4372-a90a-62ec0486cd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:44.036527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fa888-b61c-4f87-9723-01d30ebbfaa0 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:44.037479 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fa888-b61c-4f87-9723-01d30ebbfaa0 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:44.037479 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fa888-b61c-4f87-9723-01d30ebbfaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:44.068953 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-ca2fa888-b61c-4f87-9723-01d30ebbfaa0 None None] MFA Rules not processed for user `c321301f4abf4c71b0f6717b4fcc2090`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:44.070762 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-ca2fa888-b61c-4f87-9723-01d30ebbfaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:44.174950 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:49:44.192763 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 589/1191] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 20:49:43 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:49:44.216936 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a381a-c41d-4372-a90a-62ec0486cd9f None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:44.219382 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-c48a381a-c41d-4372-a90a-62ec0486cd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:44.242616 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 603/1192] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 20:49:44 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:49:44.262897 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fa888-b61c-4f87-9723-01d30ebbfaa0 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:44.268749 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-ca2fa888-b61c-4f87-9723-01d30ebbfaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:44.326124 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a381a-c41d-4372-a90a-62ec0486cd9f None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:44.336372 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99621021-c033-48ba-923a-a78b098c674d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcac07ea52e44b7cb7df360dbec74254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:44.337336 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99621021-c033-48ba-923a-a78b098c674d service glance] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:44.338470 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99621021-c033-48ba-923a-a78b098c674d service glance] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:44.339250 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99621021-c033-48ba-923a-a78b098c674d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:44.358792 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fa888-b61c-4f87-9723-01d30ebbfaa0 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:44.363882 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf53a1-7a00-4352-835b-bc6d5f74fc59 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcac07ea52e44b7cb7df360dbec74254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:44.364835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf53a1-7a00-4352-835b-bc6d5f74fc59 service glance] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:44.365214 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf53a1-7a00-4352-835b-bc6d5f74fc59 service glance] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:44.365593 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf53a1-7a00-4352-835b-bc6d5f74fc59 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:44.427403 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=100 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:49:44.450276 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99621021-c033-48ba-923a-a78b098c674d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:44.452186 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99621021-c033-48ba-923a-a78b098c674d service glance] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:44.473201 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 590/1193] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:49:44 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:49:44.480642 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf53a1-7a00-4352-835b-bc6d5f74fc59 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:44.482392 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf53a1-7a00-4352-835b-bc6d5f74fc59 service glance] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:44.499214 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 604/1194] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:49:44 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:49:54.491175 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=62 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:49:54.555816 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=4 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:49:55.177993 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432a321-b75f-402b-9c12-51aecd8f1fdc None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:55.178371 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432a321-b75f-402b-9c12-51aecd8f1fdc None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:55.178561 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432a321-b75f-402b-9c12-51aecd8f1fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:55.205793 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-6432a321-b75f-402b-9c12-51aecd8f1fdc None None] MFA Rules not processed for user `f913484e666c4cd5af84155d4c590b55`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:55.207341 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-6432a321-b75f-402b-9c12-51aecd8f1fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:55.216277 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 591/1195] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 20:49:55 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:49:55.518582 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58545607-f3ad-489b-98fe-f5b93f03f894 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:55.519226 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58545607-f3ad-489b-98fe-f5b93f03f894 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:55.519226 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58545607-f3ad-489b-98fe-f5b93f03f894 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:55.520532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 605/1196] 10.222.0.15 () {54 vars in 962 bytes} [Mon Aug 22 20:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:49:55.532343 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466cd2d-2669-43e1-9165-e27336bfd884 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:55.532650 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466cd2d-2669-43e1-9165-e27336bfd884 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:55.532943 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466cd2d-2669-43e1-9165-e27336bfd884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:55.557130 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-6466cd2d-2669-43e1-9165-e27336bfd884 None None] MFA Rules not processed for user `c18d1768fb7a4bac93b28d095b74caf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:55.558466 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-6466cd2d-2669-43e1-9165-e27336bfd884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:55.643163 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 592/1197] 10.222.0.15 () {58 vars in 1059 bytes} [Mon Aug 22 20:49:55 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:49:55.650513 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847b3fb-f301-4743-9c7a-4aa43e37b79c None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:55.650992 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847b3fb-f301-4743-9c7a-4aa43e37b79c None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:55.651398 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847b3fb-f301-4743-9c7a-4aa43e37b79c None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:55.652958 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 606/1198] 10.222.0.15 () {54 vars in 912 bytes} [Mon Aug 22 20:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:49:55.660593 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc25662-a527-4c4b-994b-2560e9944b51 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:55.660883 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc25662-a527-4c4b-994b-2560e9944b51 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:55.664959 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc25662-a527-4c4b-994b-2560e9944b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:55.685719 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-8fc25662-a527-4c4b-994b-2560e9944b51 None None] MFA Rules not processed for user `c18d1768fb7a4bac93b28d095b74caf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:55.686992 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-8fc25662-a527-4c4b-994b-2560e9944b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:55.697262 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 593/1199] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Aug 22 20:49:55 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:49:55.712170 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847b3fb-f301-4743-9c7a-4aa43e37b79c None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:55.724559 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847b3fb-f301-4743-9c7a-4aa43e37b79c None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:55.728383 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816a0cc-1b26-43e9-af1a-ac96343ce5f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcac07ea52e44b7cb7df360dbec74254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:55.729115 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816a0cc-1b26-43e9-af1a-ac96343ce5f8 service glance] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:55.729396 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816a0cc-1b26-43e9-af1a-ac96343ce5f8 service glance] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:55.729670 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816a0cc-1b26-43e9-af1a-ac96343ce5f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:55.739980 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816a0cc-1b26-43e9-af1a-ac96343ce5f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:55.741616 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816a0cc-1b26-43e9-af1a-ac96343ce5f8 service glance] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:55.754054 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 607/1200] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:49:55 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:49:56.259980 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1706a-f029-46cf-b9d4-0dcadd45c717 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:56.259980 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1706a-f029-46cf-b9d4-0dcadd45c717 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:56.259980 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1706a-f029-46cf-b9d4-0dcadd45c717 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:56.260589 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 594/1201] 10.222.0.15 () {54 vars in 912 bytes} [Mon Aug 22 20:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:49:56.266020 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f907340-1708-4627-a484-4839c9907857 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:56.266334 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f907340-1708-4627-a484-4839c9907857 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:56.266616 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f907340-1708-4627-a484-4839c9907857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:56.287363 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-9f907340-1708-4627-a484-4839c9907857 None None] MFA Rules not processed for user `340a791917d14686bb14e13544c1ce9b`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:56.289248 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-9f907340-1708-4627-a484-4839c9907857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:56.350036 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 608/1202] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Aug 22 20:49:56 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:49:56.362234 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1706a-f029-46cf-b9d4-0dcadd45c717 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:56.364113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-94b1706a-f029-46cf-b9d4-0dcadd45c717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:56.383627 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1706a-f029-46cf-b9d4-0dcadd45c717 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:56.394708 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416493f-abf1-4da0-bed7-06429bf46d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:56.395360 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416493f-abf1-4da0-bed7-06429bf46d54 service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:56.395671 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416493f-abf1-4da0-bed7-06429bf46d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:56.395947 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416493f-abf1-4da0-bed7-06429bf46d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:56.404024 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416493f-abf1-4da0-bed7-06429bf46d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:56.405474 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416493f-abf1-4da0-bed7-06429bf46d54 service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:56.414031 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 595/1203] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:49:56 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:49:56.961208 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42acf1-583e-4502-8065-7b6b1dc15c0f None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:56.962094 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42acf1-583e-4502-8065-7b6b1dc15c0f None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:56.962094 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42acf1-583e-4502-8065-7b6b1dc15c0f None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:56.963911 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 609/1204] 10.222.0.15 () {54 vars in 962 bytes} [Mon Aug 22 20:49:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:49:56.969794 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cba81-046b-4e12-bbc4-2c4def639366 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:56.970549 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cba81-046b-4e12-bbc4-2c4def639366 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:56.970549 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cba81-046b-4e12-bbc4-2c4def639366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:56.986190 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc6b44-5f0c-428c-9b6b-5bb19274afd6 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:56.986472 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc6b44-5f0c-428c-9b6b-5bb19274afd6 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:56.986746 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc6b44-5f0c-428c-9b6b-5bb19274afd6 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:56.988120 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 610/1205] 10.222.0.15 () {54 vars in 961 bytes} [Mon Aug 22 20:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:49:56.993689 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81df17-3dbd-4cdb-b076-acdeb283087d None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:56.993938 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81df17-3dbd-4cdb-b076-acdeb283087d None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:56.994318 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81df17-3dbd-4cdb-b076-acdeb283087d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:56.998599 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-c51cba81-046b-4e12-bbc4-2c4def639366 None None] MFA Rules not processed for user `c18d1768fb7a4bac93b28d095b74caf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:56.999875 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-c51cba81-046b-4e12-bbc4-2c4def639366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:57.009920 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 596/1206] 10.222.0.15 () {58 vars in 1059 bytes} [Mon Aug 22 20:49:56 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:49:57.016253 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008de833-f20b-4e7b-98b6-5e35584e3178 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:57.018197 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008de833-f20b-4e7b-98b6-5e35584e3178 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:57.018197 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008de833-f20b-4e7b-98b6-5e35584e3178 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:57.020044 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-0c81df17-3dbd-4cdb-b076-acdeb283087d None None] MFA Rules not processed for user `e4117090fe4047f9b6a2b5eab5ff218c`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:57.020460 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 597/1207] 10.222.0.15 () {54 vars in 912 bytes} [Mon Aug 22 20:49:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:49:57.021468 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-0c81df17-3dbd-4cdb-b076-acdeb283087d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:57.027170 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3079c-8685-4703-a3b2-40711115214f None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:57.027742 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3079c-8685-4703-a3b2-40711115214f None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:57.028438 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3079c-8685-4703-a3b2-40711115214f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:57.051703 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-c2b3079c-8685-4703-a3b2-40711115214f None None] MFA Rules not processed for user `c18d1768fb7a4bac93b28d095b74caf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:49:57.052958 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-c2b3079c-8685-4703-a3b2-40711115214f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:57.063165 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 598/1208] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Aug 22 20:49:57 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:49:57.075293 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3079c-8685-4703-a3b2-40711115214f None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:57.091246 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3079c-8685-4703-a3b2-40711115214f None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:57.097176 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862f5e0-8688-4ad5-b019-bf61871c3f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:57.097790 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862f5e0-8688-4ad5-b019-bf61871c3f6d service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:57.098074 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862f5e0-8688-4ad5-b019-bf61871c3f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:57.098347 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862f5e0-8688-4ad5-b019-bf61871c3f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:57.104710 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 611/1209] 10.222.0.15 () {58 vars in 1058 bytes} [Mon Aug 22 20:49:56 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:49:57.114290 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81df17-3dbd-4cdb-b076-acdeb283087d None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:57.118398 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862f5e0-8688-4ad5-b019-bf61871c3f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:57.120572 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862f5e0-8688-4ad5-b019-bf61871c3f6d service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:57.126158 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81df17-3dbd-4cdb-b076-acdeb283087d None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:57.131597 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e55058-f671-407d-8135-9f08c7aa9a6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4117090fe4047f9b6a2b5eab5ff218c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:57.132838 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e55058-f671-407d-8135-9f08c7aa9a6c service placement] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:57.133183 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e55058-f671-407d-8135-9f08c7aa9a6c service placement] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:57.133532 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e55058-f671-407d-8135-9f08c7aa9a6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:57.135346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-d7e55058-f671-407d-8135-9f08c7aa9a6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:49:57.136828 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 599/1210] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:49:57 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:49:57.148317 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e55058-f671-407d-8135-9f08c7aa9a6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:57.150002 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e55058-f671-407d-8135-9f08c7aa9a6c service placement] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:57.161075 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 612/1211] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:49:57 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:50:07.129927 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=53 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:50:07.156440 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=64 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:50:10.465599 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446222c3-7a1e-4822-95d7-89877f14ba66 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:10.474598 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446222c3-7a1e-4822-95d7-89877f14ba66 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:10.474598 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446222c3-7a1e-4822-95d7-89877f14ba66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:10.489085 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-446222c3-7a1e-4822-95d7-89877f14ba66 None None] MFA Rules not processed for user `340a791917d14686bb14e13544c1ce9b`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:50:10.490308 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-446222c3-7a1e-4822-95d7-89877f14ba66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:50:10.496751 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 600/1212] 10.222.0.65 () {58 vars in 1015 bytes} [Mon Aug 22 20:50:10 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:50:10.509723 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e55058-f671-407d-8135-9f08c7aa9a6c service placement] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:50:10.519979 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e55058-f671-407d-8135-9f08c7aa9a6c service placement] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:50:10.524181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144bbb4e-516b-41cd-acf4-2f080795990b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:50:10.524807 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bbb4e-516b-41cd-acf4-2f080795990b service neutron] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:10.525089 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bbb4e-516b-41cd-acf4-2f080795990b service neutron] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:10.525360 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bbb4e-516b-41cd-acf4-2f080795990b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:10.533607 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144bbb4e-516b-41cd-acf4-2f080795990b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:50:10.535113 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144bbb4e-516b-41cd-acf4-2f080795990b service neutron] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:50:10.544220 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 613/1213] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:50:10 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:50:11.694757 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bc085-438d-48a1-817b-a05bea34fd2a None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:11.694757 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bc085-438d-48a1-817b-a05bea34fd2a None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:11.694757 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bc085-438d-48a1-817b-a05bea34fd2a None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:11.696846 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 601/1214] 10.222.0.15 () {54 vars in 921 bytes} [Mon Aug 22 20:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:50:11.704098 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b8274-fc59-4510-9f60-9ee57aefcdc1 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:11.705350 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b8274-fc59-4510-9f60-9ee57aefcdc1 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:11.705961 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b8274-fc59-4510-9f60-9ee57aefcdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:11.728920 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-f07b8274-fc59-4510-9f60-9ee57aefcdc1 None None] MFA Rules not processed for user `c18d1768fb7a4bac93b28d095b74caf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:50:11.730284 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-f07b8274-fc59-4510-9f60-9ee57aefcdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:50:11.740892 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 614/1215] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Aug 22 20:50:11 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:50:11.772057 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bc085-438d-48a1-817b-a05bea34fd2a None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:50:11.790701 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bc085-438d-48a1-817b-a05bea34fd2a None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:50:11.797857 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa90c40-6e59-4824-ad94-16bd5bbd9d87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:50:11.797857 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa90c40-6e59-4824-ad94-16bd5bbd9d87 service nova] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:11.798147 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa90c40-6e59-4824-ad94-16bd5bbd9d87 service nova] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:11.798403 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa90c40-6e59-4824-ad94-16bd5bbd9d87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:11.808113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa90c40-6e59-4824-ad94-16bd5bbd9d87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:50:11.809726 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa90c40-6e59-4824-ad94-16bd5bbd9d87 service nova] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:50:11.821504 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 602/1216] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:50:11 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:50:17.589817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116fec5-2bf6-4df5-b4e2-e33e5ff07f59 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:17.589817 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116fec5-2bf6-4df5-b4e2-e33e5ff07f59 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:17.590515 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116fec5-2bf6-4df5-b4e2-e33e5ff07f59 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:17.591730 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 615/1217] 10.222.0.15 () {54 vars in 921 bytes} [Mon Aug 22 20:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:50:17.604222 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e83a10-307e-434b-91d4-6eca28f0b553 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:17.604711 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e83a10-307e-434b-91d4-6eca28f0b553 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:17.604711 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e83a10-307e-434b-91d4-6eca28f0b553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:17.626297 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-50e83a10-307e-434b-91d4-6eca28f0b553 None None] MFA Rules not processed for user `c18d1768fb7a4bac93b28d095b74caf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:50:17.627569 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-50e83a10-307e-434b-91d4-6eca28f0b553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:50:17.637087 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 603/1218] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Aug 22 20:50:17 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:50:17.650576 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116fec5-2bf6-4df5-b4e2-e33e5ff07f59 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:50:17.667051 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116fec5-2bf6-4df5-b4e2-e33e5ff07f59 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:50:17.672644 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4b626-debc-4b07-8e57-213157cf2b0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:50:17.673325 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4b626-debc-4b07-8e57-213157cf2b0a service nova] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:17.673608 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4b626-debc-4b07-8e57-213157cf2b0a service nova] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:17.673888 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4b626-debc-4b07-8e57-213157cf2b0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:17.684114 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4b626-debc-4b07-8e57-213157cf2b0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:50:17.685733 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4b626-debc-4b07-8e57-213157cf2b0a service nova] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:50:17.698704 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 616/1219] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:50:17 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:50:27.620885 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=12 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:50:27.694527 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=15 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:50:37.310867 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e83a10-307e-434b-91d4-6eca28f0b553 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:50:37.320906 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e83a10-307e-434b-91d4-6eca28f0b553 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:50:37.324641 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220eb582-08e2-4609-9ad2-b7dd5cd440b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:50:37.325337 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220eb582-08e2-4609-9ad2-b7dd5cd440b8 service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:37.325681 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220eb582-08e2-4609-9ad2-b7dd5cd440b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:37.325957 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220eb582-08e2-4609-9ad2-b7dd5cd440b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:37.335894 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220eb582-08e2-4609-9ad2-b7dd5cd440b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:50:37.337331 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220eb582-08e2-4609-9ad2-b7dd5cd440b8 service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:50:37.346852 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 604/1220] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:50:37 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:50:39.761353 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38cede-e281-4612-a3df-95801e3e2208 None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:39.761954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38cede-e281-4612-a3df-95801e3e2208 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:39.761954 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38cede-e281-4612-a3df-95801e3e2208 None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:39.763388 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 617/1221] 10.222.0.15 () {54 vars in 921 bytes} [Mon Aug 22 20:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:50:39.768623 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89d65f-c37f-4ee1-a5ce-0ec68d5a3756 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:39.769058 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89d65f-c37f-4ee1-a5ce-0ec68d5a3756 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:39.769149 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89d65f-c37f-4ee1-a5ce-0ec68d5a3756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:39.789281 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-0a89d65f-c37f-4ee1-a5ce-0ec68d5a3756 None None] MFA Rules not processed for user `c18d1768fb7a4bac93b28d095b74caf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:50:39.790821 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-0a89d65f-c37f-4ee1-a5ce-0ec68d5a3756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:50:39.799881 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 605/1222] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Aug 22 20:50:39 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:50:39.817070 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38cede-e281-4612-a3df-95801e3e2208 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:50:39.832059 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38cede-e281-4612-a3df-95801e3e2208 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:50:39.838333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797dc133-981e-4cbe-8e7e-5e6f1175cdde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:50:39.838952 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dc133-981e-4cbe-8e7e-5e6f1175cdde service nova] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:39.839269 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dc133-981e-4cbe-8e7e-5e6f1175cdde service nova] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:39.839632 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dc133-981e-4cbe-8e7e-5e6f1175cdde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:39.849321 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797dc133-981e-4cbe-8e7e-5e6f1175cdde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:50:39.851272 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797dc133-981e-4cbe-8e7e-5e6f1175cdde service nova] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:50:39.874030 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 618/1223] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:50:39 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:50:49.784303 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=9 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:50:49.858166 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=6 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:52:06.764491 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80651a-09fc-49c5-9bbc-ed0645fb10d6 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:52:06.767987 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80651a-09fc-49c5-9bbc-ed0645fb10d6 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:52:06.767987 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80651a-09fc-49c5-9bbc-ed0645fb10d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:52:06.795123 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-6d80651a-09fc-49c5-9bbc-ed0645fb10d6 None None] MFA Rules not processed for user `34b40b44acdb4f978e2d8c9416bc50ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:52:06.796755 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-6d80651a-09fc-49c5-9bbc-ed0645fb10d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:52:06.823046 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 606/1224] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 20:52:06 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:52:07.153893 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ea2ce-612d-4689-8251-334f762e9f60 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:52:07.154393 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ea2ce-612d-4689-8251-334f762e9f60 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:52:07.154857 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ea2ce-612d-4689-8251-334f762e9f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:52:07.238840 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-7a9ea2ce-612d-4689-8251-334f762e9f60 None None] MFA Rules not processed for user `340a791917d14686bb14e13544c1ce9b`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:52:07.240265 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-7a9ea2ce-612d-4689-8251-334f762e9f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:52:07.274271 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 619/1225] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Aug 22 20:52:07 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:52:07.285581 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80651a-09fc-49c5-9bbc-ed0645fb10d6 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:52:07.294986 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80651a-09fc-49c5-9bbc-ed0645fb10d6 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:52:07.298441 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc3c71-ad5e-4ac5-9dbf-64019882d6a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:52:07.299029 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc3c71-ad5e-4ac5-9dbf-64019882d6a5 service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:52:07.299306 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc3c71-ad5e-4ac5-9dbf-64019882d6a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:52:07.299603 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc3c71-ad5e-4ac5-9dbf-64019882d6a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:52:07.307436 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc3c71-ad5e-4ac5-9dbf-64019882d6a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:52:07.308944 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc3c71-ad5e-4ac5-9dbf-64019882d6a5 service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:52:07.316516 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 607/1226] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:52:07 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:52:17.271473 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=33 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:52:17.313283 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=21 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:52:47.237450 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3535bf9-56b5-4f78-bf4c-ae1b8a31bcac None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:52:47.240019 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3535bf9-56b5-4f78-bf4c-ae1b8a31bcac None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:52:47.240019 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3535bf9-56b5-4f78-bf4c-ae1b8a31bcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:52:47.258376 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-d3535bf9-56b5-4f78-bf4c-ae1b8a31bcac None None] MFA Rules not processed for user `34b40b44acdb4f978e2d8c9416bc50ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:52:47.259665 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-d3535bf9-56b5-4f78-bf4c-ae1b8a31bcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:52:47.266520 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 620/1227] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 20:52:47 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:52:49.934225 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc3c71-ad5e-4ac5-9dbf-64019882d6a5 service neutron] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:52:49.967614 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc3c71-ad5e-4ac5-9dbf-64019882d6a5 service neutron] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:52:49.973197 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e5e1b-1202-4dc6-bad7-b637d8ba8e9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4117090fe4047f9b6a2b5eab5ff218c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:52:49.973819 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e5e1b-1202-4dc6-bad7-b637d8ba8e9a service placement] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:52:49.974101 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e5e1b-1202-4dc6-bad7-b637d8ba8e9a service placement] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:52:49.974490 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e5e1b-1202-4dc6-bad7-b637d8ba8e9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:52:49.984185 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e5e1b-1202-4dc6-bad7-b637d8ba8e9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:52:49.985835 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e5e1b-1202-4dc6-bad7-b637d8ba8e9a service placement] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:52:49.996289 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 608/1228] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:52:49 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:52:57.252509 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=3 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:52:59.992547 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=13 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:53:06.458014 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7034070-905b-4e0d-97e6-acca1039cfd5 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:53:06.458550 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7034070-905b-4e0d-97e6-acca1039cfd5 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:53:06.458550 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7034070-905b-4e0d-97e6-acca1039cfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:53:06.477871 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-d7034070-905b-4e0d-97e6-acca1039cfd5 None None] MFA Rules not processed for user `34b40b44acdb4f978e2d8c9416bc50ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:53:06.479076 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-d7034070-905b-4e0d-97e6-acca1039cfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:53:06.486839 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 621/1229] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 20:53:06 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:53:16.472887 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=3 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:54:36.058783 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d3665-2788-4644-b73c-6db0f51de90d None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:54:36.059276 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d3665-2788-4644-b73c-6db0f51de90d None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:54:36.059371 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d3665-2788-4644-b73c-6db0f51de90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:54:36.078547 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-e33d3665-2788-4644-b73c-6db0f51de90d None None] MFA Rules not processed for user `f913484e666c4cd5af84155d4c590b55`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:54:36.080987 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-e33d3665-2788-4644-b73c-6db0f51de90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:54:36.086584 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 609/1230] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 20:54:36 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:54:40.751331 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d35c2e-f998-418a-b07d-dec3bc456101 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:54:40.754862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d35c2e-f998-418a-b07d-dec3bc456101 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:54:40.754862 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d35c2e-f998-418a-b07d-dec3bc456101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:54:40.775378 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-24d35c2e-f998-418a-b07d-dec3bc456101 None None] MFA Rules not processed for user `34b40b44acdb4f978e2d8c9416bc50ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:54:40.776854 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-24d35c2e-f998-418a-b07d-dec3bc456101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:54:40.785510 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 622/1231] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 20:54:40 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:54:43.655601 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d3665-2788-4644-b73c-6db0f51de90d None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:54:43.666492 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d3665-2788-4644-b73c-6db0f51de90d None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:54:43.670189 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ea9f7-8e3d-4fa3-8b6a-9393a33ba007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:54:43.670801 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ea9f7-8e3d-4fa3-8b6a-9393a33ba007 service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:54:43.671080 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ea9f7-8e3d-4fa3-8b6a-9393a33ba007 service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:54:43.671353 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ea9f7-8e3d-4fa3-8b6a-9393a33ba007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:54:43.681211 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ea9f7-8e3d-4fa3-8b6a-9393a33ba007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:54:43.682676 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ea9f7-8e3d-4fa3-8b6a-9393a33ba007 service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:54:43.692392 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 610/1232] 10.222.0.15 () {60 vars in 1396 bytes} [Mon Aug 22 20:54:43 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 2820 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:54:44.208297 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d35c2e-f998-418a-b07d-dec3bc456101 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:54:44.230564 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d35c2e-f998-418a-b07d-dec3bc456101 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:54:44.240973 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bd40c-7899-4560-aa23-f91e93ef837b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:54:44.241613 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bd40c-7899-4560-aa23-f91e93ef837b service nova] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:54:44.241888 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bd40c-7899-4560-aa23-f91e93ef837b service nova] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:54:44.242190 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bd40c-7899-4560-aa23-f91e93ef837b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:54:44.250988 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bd40c-7899-4560-aa23-f91e93ef837b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:54:44.252627 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bd40c-7899-4560-aa23-f91e93ef837b service nova] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:54:44.262443 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 623/1233] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:54:44 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:54:53.687858 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=9 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:54:54.257980 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=13 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:54:55.710450 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ea9f7-8e3d-4fa3-8b6a-9393a33ba007 service neutron] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:54:55.719706 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ea9f7-8e3d-4fa3-8b6a-9393a33ba007 service neutron] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:54:55.723425 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717a5df-5d33-47a2-b611-b85632b1606d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:54:55.724054 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717a5df-5d33-47a2-b611-b85632b1606d service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:54:55.724337 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717a5df-5d33-47a2-b611-b85632b1606d service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:54:55.724614 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717a5df-5d33-47a2-b611-b85632b1606d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:54:55.734479 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717a5df-5d33-47a2-b611-b85632b1606d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:54:55.736468 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717a5df-5d33-47a2-b611-b85632b1606d service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:54:55.746912 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 611/1234] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:54:55 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:54:58.269070 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bd40c-7899-4560-aa23-f91e93ef837b service nova] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:54:58.333977 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bd40c-7899-4560-aa23-f91e93ef837b service nova] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:54:58.337826 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803048d-1634-4a70-be90-99d16a074355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0b7833b75334bceb549f7184041aacc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:54:58.338481 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803048d-1634-4a70-be90-99d16a074355 service cinder] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:54:58.338757 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803048d-1634-4a70-be90-99d16a074355 service cinder] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:54:58.339026 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803048d-1634-4a70-be90-99d16a074355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:54:58.348174 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803048d-1634-4a70-be90-99d16a074355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:54:58.349598 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803048d-1634-4a70-be90-99d16a074355 service cinder] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:54:58.359470 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 624/1235] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:54:58 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:55:00.085376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717a5df-5d33-47a2-b611-b85632b1606d service neutron] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:55:00.094276 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717a5df-5d33-47a2-b611-b85632b1606d service neutron] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:55:00.097881 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df415d5-d893-4804-b3e7-ef9d1201cae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:55:00.098471 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df415d5-d893-4804-b3e7-ef9d1201cae3 service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:55:00.098746 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df415d5-d893-4804-b3e7-ef9d1201cae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:55:00.099013 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df415d5-d893-4804-b3e7-ef9d1201cae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:55:00.108510 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df415d5-d893-4804-b3e7-ef9d1201cae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:55:00.109942 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df415d5-d893-4804-b3e7-ef9d1201cae3 service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:55:00.120281 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 612/1236] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:55:00 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:55:08.355224 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=30 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:55:10.121864 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=12 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:55:10.191976 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803048d-1634-4a70-be90-99d16a074355 service cinder] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:55:10.201905 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803048d-1634-4a70-be90-99d16a074355 service cinder] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:55:10.207333 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74abc2-04c9-4d01-87b2-5c46c50f4779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:55:10.208623 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74abc2-04c9-4d01-87b2-5c46c50f4779 service neutron] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:55:10.209186 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74abc2-04c9-4d01-87b2-5c46c50f4779 service neutron] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:55:10.209740 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74abc2-04c9-4d01-87b2-5c46c50f4779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:55:10.218697 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74abc2-04c9-4d01-87b2-5c46c50f4779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:55:10.220820 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74abc2-04c9-4d01-87b2-5c46c50f4779 service neutron] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:55:10.230037 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 625/1237] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:55:10 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:55:20.226335 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=6 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:56:23.954207 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df415d5-d893-4804-b3e7-ef9d1201cae3 service neutron] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:23.967584 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df415d5-d893-4804-b3e7-ef9d1201cae3 service neutron] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:23.974193 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830ff42-8f2e-4cde-b5d1-06dce8cc0364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:23.974831 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830ff42-8f2e-4cde-b5d1-06dce8cc0364 service nova] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:23.975165 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830ff42-8f2e-4cde-b5d1-06dce8cc0364 service nova] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:23.975444 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830ff42-8f2e-4cde-b5d1-06dce8cc0364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:23.985517 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830ff42-8f2e-4cde-b5d1-06dce8cc0364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:23.986805 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830ff42-8f2e-4cde-b5d1-06dce8cc0364 service nova] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:23.997816 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 613/1238] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:56:23 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:56:25.615772 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74abc2-04c9-4d01-87b2-5c46c50f4779 service neutron] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:25.630573 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74abc2-04c9-4d01-87b2-5c46c50f4779 service neutron] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:25.635802 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce004d2f-6b16-4fac-a39b-253fa2ed20db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18d1768fb7a4bac93b28d095b74caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:25.636550 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce004d2f-6b16-4fac-a39b-253fa2ed20db service nova] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:25.636929 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce004d2f-6b16-4fac-a39b-253fa2ed20db service nova] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:25.637328 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce004d2f-6b16-4fac-a39b-253fa2ed20db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:25.646786 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce004d2f-6b16-4fac-a39b-253fa2ed20db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:25.648608 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce004d2f-6b16-4fac-a39b-253fa2ed20db service nova] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:25.660017 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 626/1239] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:56:25 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:56:33.993627 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=6 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:56:35.654990 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=6 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:56:40.450762 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830ff42-8f2e-4cde-b5d1-06dce8cc0364 service nova] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:40.460547 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830ff42-8f2e-4cde-b5d1-06dce8cc0364 service nova] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:40.464420 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505aa5fc-6a59-468c-b9cc-afcc20cd36e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:40.465113 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505aa5fc-6a59-468c-b9cc-afcc20cd36e5 service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:40.465400 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505aa5fc-6a59-468c-b9cc-afcc20cd36e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:40.465678 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505aa5fc-6a59-468c-b9cc-afcc20cd36e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:40.539372 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505aa5fc-6a59-468c-b9cc-afcc20cd36e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:40.540945 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505aa5fc-6a59-468c-b9cc-afcc20cd36e5 service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:40.564532 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 614/1240] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:56:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:56:44.339113 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cf006-5bea-4edc-9dbc-63f999ede06d None None] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:44.344291 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cf006-5bea-4edc-9dbc-63f999ede06d None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:44.344291 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cf006-5bea-4edc-9dbc-63f999ede06d None None] PATH_INFO: `/` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:44.344291 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 627/1241] 10.222.0.15 () {54 vars in 921 bytes} [Mon Aug 22 20:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:56:44.354126 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e5694-18cb-44a3-a53a-d6d5aa89f7f9 None None] REQUEST_METHOD: `POST` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:44.354816 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e5694-18cb-44a3-a53a-d6d5aa89f7f9 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:44.355034 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e5694-18cb-44a3-a53a-d6d5aa89f7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:44.408545 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.auth.core [None req-258e5694-18cb-44a3-a53a-d6d5aa89f7f9 None None] MFA Rules not processed for user `e4117090fe4047f9b6a2b5eab5ff218c`. Rule list: `[]` (Enabled: `True`). {{(pid=88641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:56:44.409816 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-258e5694-18cb-44a3-a53a-d6d5aa89f7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:56:44.419083 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 615/1242] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Aug 22 20:56:44 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:56:44.431338 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cf006-5bea-4edc-9dbc-63f999ede06d None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:44.444590 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cf006-5bea-4edc-9dbc-63f999ede06d None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:44.449679 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd7895-444b-4beb-9af9-81d12784f805 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4117090fe4047f9b6a2b5eab5ff218c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:44.450275 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd7895-444b-4beb-9af9-81d12784f805 service placement] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:44.450556 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd7895-444b-4beb-9af9-81d12784f805 service placement] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:44.450828 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd7895-444b-4beb-9af9-81d12784f805 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:44.460314 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd7895-444b-4beb-9af9-81d12784f805 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:44.461891 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd7895-444b-4beb-9af9-81d12784f805 service placement] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:44.471826 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 628/1243] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:56:44 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:56:48.278424 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23024b70-b454-46f7-8723-38aebc7e94c0 None None] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:48.278958 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23024b70-b454-46f7-8723-38aebc7e94c0 None None] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:48.278958 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23024b70-b454-46f7-8723-38aebc7e94c0 None None] PATH_INFO: `/` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:48.280359 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 616/1244] 10.222.0.15 () {54 vars in 921 bytes} [Mon Aug 22 20:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:56:48.291751 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f855f-9a52-4103-a63c-0544638f07f1 None None] REQUEST_METHOD: `POST` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:48.292320 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f855f-9a52-4103-a63c-0544638f07f1 None None] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:48.292320 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f855f-9a52-4103-a63c-0544638f07f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:48.311992 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.auth.core [None req-296f855f-9a52-4103-a63c-0544638f07f1 None None] MFA Rules not processed for user `e4117090fe4047f9b6a2b5eab5ff218c`. Rule list: `[]` (Enabled: `True`). {{(pid=88640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:56:48.313346 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-296f855f-9a52-4103-a63c-0544638f07f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:56:48.323313 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 629/1245] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Aug 22 20:56:48 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:56:48.335009 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23024b70-b454-46f7-8723-38aebc7e94c0 None None] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:48.348755 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23024b70-b454-46f7-8723-38aebc7e94c0 None None] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:48.353697 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61527de4-6777-4688-abcc-c4a40103ad6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4117090fe4047f9b6a2b5eab5ff218c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:48.354285 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61527de4-6777-4688-abcc-c4a40103ad6a service placement] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:48.354563 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61527de4-6777-4688-abcc-c4a40103ad6a service placement] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:48.354833 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61527de4-6777-4688-abcc-c4a40103ad6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:48.363181 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61527de4-6777-4688-abcc-c4a40103ad6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:48.364827 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61527de4-6777-4688-abcc-c4a40103ad6a service placement] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:48.374402 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 617/1246] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:56:48 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:56:48.437947 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f855f-9a52-4103-a63c-0544638f07f1 None None] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:48.449368 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f855f-9a52-4103-a63c-0544638f07f1 None None] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:48.454076 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365bd02-3eab-4a04-a438-16b46ce277b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:48.455037 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365bd02-3eab-4a04-a438-16b46ce277b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:48.455037 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365bd02-3eab-4a04-a438-16b46ce277b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:48.455417 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365bd02-3eab-4a04-a438-16b46ce277b7 admin admin] PATH_INFO: `/v3/users/f913484e666c4cd5af84155d4c590b55` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:48.456606 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365bd02-3eab-4a04-a438-16b46ce277b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f913484e666c4cd5af84155d4c590b55)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:48.457624 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: WARNING py.warnings [None req-f365bd02-3eab-4a04-a438-16b46ce277b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:56:48.457624 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: warnings.warn(msg) Aug 22 20:56:48.457624 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: Aug 22 20:56:48.458835 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365bd02-3eab-4a04-a438-16b46ce277b7 admin admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:48.649130 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-f365bd02-3eab-4a04-a438-16b46ce277b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f913484e666c4cd5af84155d4c590b55'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:48.649721 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-f365bd02-3eab-4a04-a438-16b46ce277b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f913484e666c4cd5af84155d4c590b55'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:48.752311 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-f365bd02-3eab-4a04-a438-16b46ce277b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f913484e666c4cd5af84155d4c590b55'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:48.772539 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-f365bd02-3eab-4a04-a438-16b46ce277b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f913484e666c4cd5af84155d4c590b55'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:48.782580 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-f365bd02-3eab-4a04-a438-16b46ce277b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f913484e666c4cd5af84155d4c590b55'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:48.789149 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 630/1247] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 20:56:48 2022] DELETE /identity/v3/users/f913484e666c4cd5af84155d4c590b55 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:56:49.080169 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61527de4-6777-4688-abcc-c4a40103ad6a service placement] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:49.100254 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61527de4-6777-4688-abcc-c4a40103ad6a service placement] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:49.153048 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029971c-2c5e-44e9-b09c-0946151df86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:49.153698 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029971c-2c5e-44e9-b09c-0946151df86d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:49.153979 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029971c-2c5e-44e9-b09c-0946151df86d admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:49.154249 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029971c-2c5e-44e9-b09c-0946151df86d admin admin] PATH_INFO: `/v3/projects/9d2e90e5da7e4b92bbda1722a3032f14` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:49.155349 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029971c-2c5e-44e9-b09c-0946151df86d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d2e90e5da7e4b92bbda1722a3032f14)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:49.156397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: WARNING py.warnings [None req-9029971c-2c5e-44e9-b09c-0946151df86d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:56:49.156397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: warnings.warn(msg) Aug 22 20:56:49.156397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: Aug 22 20:56:49.157578 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029971c-2c5e-44e9-b09c-0946151df86d admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:49.288884 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:56:49.303139 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-9029971c-2c5e-44e9-b09c-0946151df86d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d2e90e5da7e4b92bbda1722a3032f14', 'request_id': 'req-9029971c-2c5e-44e9-b09c-0946151df86d'} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:49.409796 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-9029971c-2c5e-44e9-b09c-0946151df86d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d2e90e5da7e4b92bbda1722a3032f14', 'request_id': 'req-9029971c-2c5e-44e9-b09c-0946151df86d'} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:49.424479 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-9029971c-2c5e-44e9-b09c-0946151df86d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d2e90e5da7e4b92bbda1722a3032f14', 'request_id': 'req-9029971c-2c5e-44e9-b09c-0946151df86d'} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:49.450299 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-9029971c-2c5e-44e9-b09c-0946151df86d admin admin] The token cache is being invalidate because project 9d2e90e5da7e4b92bbda1722a3032f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:56:49.450299 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-9029971c-2c5e-44e9-b09c-0946151df86d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:49.450299 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-9029971c-2c5e-44e9-b09c-0946151df86d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:49.450994 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 618/1248] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 20:56:49 2022] DELETE /identity/v3/projects/9d2e90e5da7e4b92bbda1722a3032f14 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:56:49.455461 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365bd02-3eab-4a04-a438-16b46ce277b7 admin admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:49.457815 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-f365bd02-3eab-4a04-a438-16b46ce277b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:56:49.471753 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365bd02-3eab-4a04-a438-16b46ce277b7 admin admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:49.529662 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293d691-45e4-47db-8d6b-6191b5145547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:49.530316 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293d691-45e4-47db-8d6b-6191b5145547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:49.530599 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293d691-45e4-47db-8d6b-6191b5145547 admin admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:49.530876 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293d691-45e4-47db-8d6b-6191b5145547 admin admin] PATH_INFO: `/v3/users/b7533efc8c024df4adb7e196f892252a` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:49.532103 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293d691-45e4-47db-8d6b-6191b5145547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7533efc8c024df4adb7e196f892252a)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:49.534200 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293d691-45e4-47db-8d6b-6191b5145547 admin admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:49.784096 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-1293d691-45e4-47db-8d6b-6191b5145547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7533efc8c024df4adb7e196f892252a'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:49.784723 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-1293d691-45e4-47db-8d6b-6191b5145547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7533efc8c024df4adb7e196f892252a'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:49.832445 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-1293d691-45e4-47db-8d6b-6191b5145547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7533efc8c024df4adb7e196f892252a'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:49.833877 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:56:49.847413 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-1293d691-45e4-47db-8d6b-6191b5145547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7533efc8c024df4adb7e196f892252a'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:49.854660 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-1293d691-45e4-47db-8d6b-6191b5145547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7533efc8c024df4adb7e196f892252a'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:49.860717 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 631/1249] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 20:56:49 2022] DELETE /identity/v3/users/b7533efc8c024df4adb7e196f892252a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:56:50.068397 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029971c-2c5e-44e9-b09c-0946151df86d admin admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:50.070705 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-9029971c-2c5e-44e9-b09c-0946151df86d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:56:50.084002 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029971c-2c5e-44e9-b09c-0946151df86d admin admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:50.144877 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312001bf-e0a3-4527-8388-5a0ae6bc022d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:50.145534 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312001bf-e0a3-4527-8388-5a0ae6bc022d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:50.145812 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312001bf-e0a3-4527-8388-5a0ae6bc022d admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:50.146086 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312001bf-e0a3-4527-8388-5a0ae6bc022d admin admin] PATH_INFO: `/v3/projects/23a464497a3d495b93fd6da1fac46f6a` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:50.147202 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312001bf-e0a3-4527-8388-5a0ae6bc022d admin admin] RBAC: Authorizing `identity:delete_project(project_id=23a464497a3d495b93fd6da1fac46f6a)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:50.149280 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312001bf-e0a3-4527-8388-5a0ae6bc022d admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:50.342797 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-312001bf-e0a3-4527-8388-5a0ae6bc022d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23a464497a3d495b93fd6da1fac46f6a', 'request_id': 'req-312001bf-e0a3-4527-8388-5a0ae6bc022d'} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:50.432173 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-312001bf-e0a3-4527-8388-5a0ae6bc022d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23a464497a3d495b93fd6da1fac46f6a', 'request_id': 'req-312001bf-e0a3-4527-8388-5a0ae6bc022d'} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:50.439230 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-312001bf-e0a3-4527-8388-5a0ae6bc022d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23a464497a3d495b93fd6da1fac46f6a', 'request_id': 'req-312001bf-e0a3-4527-8388-5a0ae6bc022d'} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:50.449744 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-312001bf-e0a3-4527-8388-5a0ae6bc022d admin admin] The token cache is being invalidate because project 23a464497a3d495b93fd6da1fac46f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:56:50.450012 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-312001bf-e0a3-4527-8388-5a0ae6bc022d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:50.450666 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-312001bf-e0a3-4527-8388-5a0ae6bc022d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:50.452314 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 619/1250] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 20:56:50 2022] DELETE /identity/v3/projects/23a464497a3d495b93fd6da1fac46f6a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:56:59.935004 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=11,keystone:DELETE=2 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:57:00.446609 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:DELETE=12,keystone:SELECT=67,keystone:INSERT=2 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:57:54.263749 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293d691-45e4-47db-8d6b-6191b5145547 admin admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:57:54.265834 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-1293d691-45e4-47db-8d6b-6191b5145547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:57:54.337752 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293d691-45e4-47db-8d6b-6191b5145547 admin admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:57:54.398339 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1575d52-ffbd-45e1-9b7d-f3f2fec44319 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4117090fe4047f9b6a2b5eab5ff218c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:57:54.400206 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1575d52-ffbd-45e1-9b7d-f3f2fec44319 service placement] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:57:54.400337 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1575d52-ffbd-45e1-9b7d-f3f2fec44319 service placement] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:57:54.400594 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1575d52-ffbd-45e1-9b7d-f3f2fec44319 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:57:54.402351 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-f1575d52-ffbd-45e1-9b7d-f3f2fec44319 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:57:54.413543 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1575d52-ffbd-45e1-9b7d-f3f2fec44319 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:57:54.415228 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1575d52-ffbd-45e1-9b7d-f3f2fec44319 service placement] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:57:54.424983 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 632/1251] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:57:54 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:58:04.420916 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=58 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:58:37.138085 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312001bf-e0a3-4527-8388-5a0ae6bc022d admin admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:58:37.139621 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-312001bf-e0a3-4527-8388-5a0ae6bc022d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:58:37.196682 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312001bf-e0a3-4527-8388-5a0ae6bc022d admin admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:58:37.200366 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b109f9-0f47-49b6-bace-14aec1a82688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340a791917d14686bb14e13544c1ce9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:58:37.200971 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b109f9-0f47-49b6-bace-14aec1a82688 service neutron] REQUEST_METHOD: `GET` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:58:37.201256 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b109f9-0f47-49b6-bace-14aec1a82688 service neutron] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:58:37.201872 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b109f9-0f47-49b6-bace-14aec1a82688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:58:37.203625 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-47b109f9-0f47-49b6-bace-14aec1a82688 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:58:37.266289 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b109f9-0f47-49b6-bace-14aec1a82688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:58:37.267724 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b109f9-0f47-49b6-bace-14aec1a82688 service neutron] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:58:37.277688 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 620/1252] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 20:58:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:58:44.289241 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1575d52-ffbd-45e1-9b7d-f3f2fec44319 service placement] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:58:44.290617 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-f1575d52-ffbd-45e1-9b7d-f3f2fec44319 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:58:44.304395 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1575d52-ffbd-45e1-9b7d-f3f2fec44319 service placement] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:58:44.308896 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f300e41-a263-4e17-baf2-867348ccdf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:58:44.309539 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f300e41-a263-4e17-baf2-867348ccdf2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:58:44.309800 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f300e41-a263-4e17-baf2-867348ccdf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:58:44.310070 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f300e41-a263-4e17-baf2-867348ccdf2c admin admin] PATH_INFO: `/v3/users/34b40b44acdb4f978e2d8c9416bc50ad` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:58:44.311181 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f300e41-a263-4e17-baf2-867348ccdf2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=34b40b44acdb4f978e2d8c9416bc50ad)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:58:44.313130 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f300e41-a263-4e17-baf2-867348ccdf2c admin admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:58:44.493900 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-3f300e41-a263-4e17-baf2-867348ccdf2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34b40b44acdb4f978e2d8c9416bc50ad'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:58:44.494491 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-3f300e41-a263-4e17-baf2-867348ccdf2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34b40b44acdb4f978e2d8c9416bc50ad'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:58:44.622588 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-3f300e41-a263-4e17-baf2-867348ccdf2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34b40b44acdb4f978e2d8c9416bc50ad'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:58:44.635746 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-3f300e41-a263-4e17-baf2-867348ccdf2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34b40b44acdb4f978e2d8c9416bc50ad'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:58:44.642590 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-3f300e41-a263-4e17-baf2-867348ccdf2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34b40b44acdb4f978e2d8c9416bc50ad'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:58:44.649329 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 633/1253] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 20:58:44 2022] DELETE /identity/v3/users/34b40b44acdb4f978e2d8c9416bc50ad => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:58:44.962008 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b109f9-0f47-49b6-bace-14aec1a82688 service neutron] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:58:44.974227 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b109f9-0f47-49b6-bace-14aec1a82688 service neutron] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:58:45.039059 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150e383-44c5-485b-9d15-8d53adf44647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:58:45.039790 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150e383-44c5-485b-9d15-8d53adf44647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:58:45.040121 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150e383-44c5-485b-9d15-8d53adf44647 admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:58:45.040339 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150e383-44c5-485b-9d15-8d53adf44647 admin admin] PATH_INFO: `/v3/projects/606319096e0a4732a32d5262dd17ba73` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:58:45.041468 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150e383-44c5-485b-9d15-8d53adf44647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=606319096e0a4732a32d5262dd17ba73)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:58:45.043429 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150e383-44c5-485b-9d15-8d53adf44647 admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:58:45.218577 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-5150e383-44c5-485b-9d15-8d53adf44647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '606319096e0a4732a32d5262dd17ba73', 'request_id': 'req-5150e383-44c5-485b-9d15-8d53adf44647'} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:58:45.221105 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:58:45.359376 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-5150e383-44c5-485b-9d15-8d53adf44647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '606319096e0a4732a32d5262dd17ba73', 'request_id': 'req-5150e383-44c5-485b-9d15-8d53adf44647'} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:58:45.366864 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-5150e383-44c5-485b-9d15-8d53adf44647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '606319096e0a4732a32d5262dd17ba73', 'request_id': 'req-5150e383-44c5-485b-9d15-8d53adf44647'} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:58:45.377911 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-5150e383-44c5-485b-9d15-8d53adf44647 admin admin] The token cache is being invalidate because project 606319096e0a4732a32d5262dd17ba73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:58:45.378180 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-5150e383-44c5-485b-9d15-8d53adf44647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:58:45.382503 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-5150e383-44c5-485b-9d15-8d53adf44647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:58:45.382503 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 621/1254] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 20:58:44 2022] DELETE /identity/v3/projects/606319096e0a4732a32d5262dd17ba73 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:58:45.384684 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f300e41-a263-4e17-baf2-867348ccdf2c admin admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:58:45.386088 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-3f300e41-a263-4e17-baf2-867348ccdf2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:58:45.399141 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f300e41-a263-4e17-baf2-867348ccdf2c admin admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:58:45.454821 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9d4f1-6c72-4b41-9156-ddb4a97cfec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:58:45.455933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9d4f1-6c72-4b41-9156-ddb4a97cfec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:58:45.455933 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9d4f1-6c72-4b41-9156-ddb4a97cfec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:58:45.456136 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9d4f1-6c72-4b41-9156-ddb4a97cfec0 admin admin] PATH_INFO: `/v3/users/c321301f4abf4c71b0f6717b4fcc2090` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:58:45.457167 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9d4f1-6c72-4b41-9156-ddb4a97cfec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c321301f4abf4c71b0f6717b4fcc2090)` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:58:45.459138 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9d4f1-6c72-4b41-9156-ddb4a97cfec0 admin admin] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:58:45.723258 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-06e9d4f1-6c72-4b41-9156-ddb4a97cfec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c321301f4abf4c71b0f6717b4fcc2090'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:58:45.723982 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-06e9d4f1-6c72-4b41-9156-ddb4a97cfec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c321301f4abf4c71b0f6717b4fcc2090'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:58:45.817368 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-06e9d4f1-6c72-4b41-9156-ddb4a97cfec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c321301f4abf4c71b0f6717b4fcc2090'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:58:45.830612 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-06e9d4f1-6c72-4b41-9156-ddb4a97cfec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c321301f4abf4c71b0f6717b4fcc2090'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:58:45.832636 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:58:45.838342 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.notifications [None req-06e9d4f1-6c72-4b41-9156-ddb4a97cfec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c321301f4abf4c71b0f6717b4fcc2090'} {{(pid=88640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:58:45.844299 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 634/1255] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 20:58:45 2022] DELETE /identity/v3/users/c321301f4abf4c71b0f6717b4fcc2090 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:58:46.140881 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150e383-44c5-485b-9d15-8d53adf44647 admin admin] Authenticating user token {{(pid=88641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:58:46.142392 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.fernet_utils [None req-5150e383-44c5-485b-9d15-8d53adf44647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:58:46.161374 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150e383-44c5-485b-9d15-8d53adf44647 admin admin] Validating token access rules against request {{(pid=88641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:58:46.219174 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd8d9b-3c13-4feb-a4bb-9135e353e87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146ec9a584bf4142acfd366d51db1f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d17f0c019c419fa2ba2277c76a76b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:58:46.219833 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd8d9b-3c13-4feb-a4bb-9135e353e87c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:58:46.220108 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd8d9b-3c13-4feb-a4bb-9135e353e87c admin admin] SCRIPT_NAME: `/identity` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:58:46.220372 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd8d9b-3c13-4feb-a4bb-9135e353e87c admin admin] PATH_INFO: `/v3/projects/24747e8df9554b86af7e012c303b9ad6` {{(pid=88641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:58:46.221472 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd8d9b-3c13-4feb-a4bb-9135e353e87c admin admin] RBAC: Authorizing `identity:delete_project(project_id=24747e8df9554b86af7e012c303b9ad6)` {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:58:46.223398 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd8d9b-3c13-4feb-a4bb-9135e353e87c admin admin] RBAC: Authorization granted {{(pid=88641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:58:46.314599 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-c0dd8d9b-3c13-4feb-a4bb-9135e353e87c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24747e8df9554b86af7e012c303b9ad6', 'request_id': 'req-c0dd8d9b-3c13-4feb-a4bb-9135e353e87c'} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:58:46.371009 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-c0dd8d9b-3c13-4feb-a4bb-9135e353e87c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24747e8df9554b86af7e012c303b9ad6', 'request_id': 'req-c0dd8d9b-3c13-4feb-a4bb-9135e353e87c'} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:58:46.377695 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-c0dd8d9b-3c13-4feb-a4bb-9135e353e87c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24747e8df9554b86af7e012c303b9ad6', 'request_id': 'req-c0dd8d9b-3c13-4feb-a4bb-9135e353e87c'} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:58:46.389171 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-c0dd8d9b-3c13-4feb-a4bb-9135e353e87c admin admin] The token cache is being invalidate because project 24747e8df9554b86af7e012c303b9ad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:58:46.389394 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-c0dd8d9b-3c13-4feb-a4bb-9135e353e87c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:58:46.390044 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG keystone.notifications [None req-c0dd8d9b-3c13-4feb-a4bb-9135e353e87c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:58:46.391532 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: [pid: 88641|app: 0|req: 622/1256] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 20:58:46 2022] DELETE /identity/v3/projects/24747e8df9554b86af7e012c303b9ad6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:58:56.228007 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG dbcounter [-] [88640] Writing DB stats keystone:SELECT=4 {{(pid=88640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:58:56.386039 dv-osbrick-786733-8-ceph devstack@keystone.service[88641]: DEBUG dbcounter [-] [88641] Writing DB stats keystone:DELETE=10,keystone:SELECT=57,keystone:INSERT=1 {{(pid=88641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 21:02:57.421005 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9d4f1-6c72-4b41-9156-ddb4a97cfec0 admin admin] Authenticating user token {{(pid=88640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 21:02:57.422205 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-06e9d4f1-6c72-4b41-9156-ddb4a97cfec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 21:02:57.550070 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9d4f1-6c72-4b41-9156-ddb4a97cfec0 admin admin] Validating token access rules against request {{(pid=88640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 21:02:57.608173 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce38f26-49f5-4119-a95e-ec11aeb8b431 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4117090fe4047f9b6a2b5eab5ff218c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bda5c44ace24608b8ca69e9059d73ef', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 21:02:57.608774 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce38f26-49f5-4119-a95e-ec11aeb8b431 service placement] REQUEST_METHOD: `GET` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 21:02:57.609052 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce38f26-49f5-4119-a95e-ec11aeb8b431 service placement] SCRIPT_NAME: `/identity` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 21:02:57.609327 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce38f26-49f5-4119-a95e-ec11aeb8b431 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 21:02:57.611097 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.fernet_utils [None req-9ce38f26-49f5-4119-a95e-ec11aeb8b431 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 21:02:57.621850 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce38f26-49f5-4119-a95e-ec11aeb8b431 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 21:02:57.623411 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce38f26-49f5-4119-a95e-ec11aeb8b431 service placement] RBAC: Authorization granted {{(pid=88640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 21:02:57.632959 dv-osbrick-786733-8-ceph devstack@keystone.service[88640]: [pid: 88640|app: 0|req: 635/1257] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 21:02:57 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)